A New Depth and Disparity Visualization Algorithm for Stereoscopic Camera Rig

Ramesh, Rohit,Shin, Heung-Sub,Jeong, Shin-Il,Chung, Wan-Young The Korea Institute of Information and Commucation 2010 Journal of information and communication convergen Vol.8 No.6

In this paper, we present the effect of binocular cues which plays crucial role for the visualization of a stereoscopic or 3D image. This study is useful in extracting depth and disparity information by image processing technique. A linear relation between the object distance and the image distance is presented to discuss the cause of cybersickness. In the experimental results, three dimensional view of the depth map between the 2D images is shown. A median filter is used to reduce the noises available in the disparity map image. After the median filter, two filter algorithms such as 'Gabor' filter and 'Canny' filter are tested for disparity visualization between two images. The 'Gabor' filter is to estimate the disparity by texture extraction and discrimination methods of the two images, and the 'Canny' filter is used to visualize the disparity by edge detection of the two color images obtained from stereoscopic cameras. The 'Canny' filter is better choice for estimating the disparity rather than the 'Gabor' filter because the 'Canny' filter is much more efficient than 'Gabor' filter in terms of detecting the edges. 'Canny' filter changes the color images directly into color edges without converting them into the grayscale. As a result, more clear edges of the stereo images as compared to the edge detection by 'Gabor' filter can be obtained. Since the main goal of the research is to estimate the horizontal disparity of all possible regions or edges of the images, thus the 'Canny' filter is proposed for decipherable visualization of the disparity.

양안 입체시에 의한 3차원 표면의 복원

정남채,Jung, Nam-Chae 한국융합신호처리학회 2005 융합신호처리학회 논문지 (JISPS) Vol.6 No.3

본 논문에서는 심리학 생리학적 지식을 기초로 하여 좌우 망막을 양안 입체시로 대응시켜 얻은 2매의 화상으로부터 깊이 정보를 추출하는 신경회로 모델을 제안하고 3차원 표면의 복원법을 검토한다. 화상의 특징을 근거로 하여 시차를 추출할 경우, 경계 부분에 유사한 특징이 반복된다면 경우 올바른 깊이 정보를 검출할 수 없다. 본 논문에서 제안된 신경회로 모델은 시차의 추출, 시차의 통합, 시차의 보간에 의하여 시차를 결정한다. 또한, 깊이 정보를 보간하여 3차원 형상을 복원하고 그 복원된 3차원 형상에 좌입력 화상을 투영하여 3차원 표면을 복원하는 법을 제안하고, 실험을 통하여 시차 추출 시간을 대폭 줄일 수 있음을 확인하였다. In this paper, a model of neural circuit was proposed, which abstracts the depth information in two images gotten from right and left retinas. The proposed neural circuit corresponds to binocular stereo vision based on psychologic and physiological knowledge, and we examine a restoration method of three-dimensional surface. In case of drawing a disparity based on characteristics of images, we can not abstract the depth information correctly if resemblant characteristics are repeated on the boundary region of an object. A binocular disparity is decided in a model of neural circuit by abstraction, synthesis, and correction of a disparity. And we propose a method which restores three-dimensional shape by correcting a depth information, and also restores a three-dimensional surface by mapping a left input image on the restored three-dimensional shape. And we confirmed that the computation time for disparity abstraction can be greatly reduced through the simulation.

양안시차를 이용한 3D 입체영상 장치의 시청에 있어 성인및 아동의 동공간거리가 미치는 영향

강석현,홍형기 한국안광학회 2011 한국안광학회지 Vol.16 No.3

Purpose: In watching 3D stereoscopic display using the binocular disparity, effect of difference of the pupillary distance between the adults and children on the perception of depth were investigated. Methods: The average PD of children was determined from the PD measurements of children of the elementary school of 2nd and 3rd grade in Seoul. The location of crossing visual axes were derived from the relation of the binocular disparity and the PD for the adults and children. Results: The average PD of the children was measured to be 57.3 mm which was smaller than the average PD of the adults that was known to be about 65 mm. As the binocular disparity increases to the positive direction, the crossing location steeply moves farther behind the screen. On the other hand, when the binocular disparity increases to the negative direction, the crossing location gradually moves toward the viewer. For the same amount of the binocular disparity, the crossing locations were derived to be larger for the children than the adults due to the difference of the PD. Therefore, children will perceive larger depth than the adults. Conclusions: Small PD of the viewer causes the larger amount of the depth perception. In producing the stereoscopic images, the average PD of children as well as adults need to be considered. 목적: 양안시차를 이용한 3D 입체영상 시청(관람) 시 성인과 아동의 동공간거리의 차이가 심도지각에 미치는 영 향을 분석하였다. 방법: 성인의 동공간거리는 기준 동공간거리로 설정하고, 아동의 동공간거리는 초등학교 저학년을 대상으로 측정한 표본의 분석값으로 설정하였다. 이렇게 설정된 동공간거리 값에 따른 양안시차(binocular disparity) 와 교차점의 위치(crossing location) 관계를 분석하였다. 결과: 설정된 동공간거리 값은 아동이 57.3 mm로 성인의 65 mm보다 작았다. 양안시차가 (+)방향으로 증가할 때 교차점의 위치는 스크린 뒤로 멀어지며 가파르게 증가한다. 또한 (-)방향으로 시차량이 증가할 때 교차점의 위치는 스크린 앞으로 멀어지며 완만하게 증가한다. 성인과 아동, 두 집단 간 교차점 위치의 차이(difference of crossing locations)는 양안시차가 (-)방향일 때 보다 (+)방향일 때 크 게 나타난다. 즉 동일한 양안시차에 대하여 아동은 성인에 비해 근치감과 원치감이 더 크게 느껴질 것으로 예상할 수 있다. 결론: 동일한 양안시차 조건의 3D 입체영상을 시청(관람) 시 아동이 느끼는 입체감은 성인에 비해 깊이감 이 더 크다. 그러므로 3D 입체영상 제작 시 아동의 동공간거리를 고려한 양안시차 설정이 필요하다.

Wesson Fixation Disparity Card를 이용한 양안시 분석

박현주 한국안광학회 2007 한국안광학회지 Vol.12 No.1

A commonly used device to determine fixation disparity curves is the Wesson Fixation Disparity Card. A fixation disparity curve is an x, y coordinate plot of the angular amount of fixation disparity as a function of the power of prisms through which the patient views. The fixation disparity curve variables that are used to aid in the diagnosis and management of binocular vision disorders include the x-intercept, y-intercept, curve slope and curve type. Fixation disparity curves were measured on 102 subjects with the Wesson fixation disparity card. The purpose of this study is to investigate distribution of the curve types obtained with Wesson card. Fixation Disparity by Wesson Fixation Disparity Card were that in case of type Ⅰ 63.0%, in case of type Ⅱ 0.0%, in case of type Ⅲ 25.0% and in case of type Ⅳ 12.0%. 가장 일반적으로 사용되는 주시시차 측정 장치는 Wesson 주시시차 카드이다. 주시시차곡선은 추가한 프리즘량과 주시시차량에 대한 함수이며, 주시시차 곡선에서 진단과 처방에 사용되는 값은 x-절편, y-절편, 기울기, 곡선 타입이다. Wesson 주시시차 카드를 이용하여 102명을 대상으로 주시시차를 측정하였는데, 이 연구의 목적은 Wesson 주시시차카드를 이용한 주시시차 검사법에 의해 주시시차의 방향과 분포 등을 알아보고, 진단과 처방에 응용하는데 있다. Wesson 주시시차 카드를 이용한 주시시차 측정 결과 type Ⅰ은 63.0%, type Ⅱ는 0.0%, type Ⅲ는 25.0% type Ⅳ는 12.0%를 얻었다.

양안 시차와 T-교차 정보가 White 착시 자극의 밝기 지각에 미치는 영향

김경호(KyungHo Kim),김신우(ShinWoo Kim),이형철(Hyung-Chul O. Li) 한국인지과학회 2017 인지과학 Vol.28 No.2

본 연구의 목적은 규칙적으로 반복되는 구조가 존재하는 자극 상황에서 양안시차와 T-교차가 White 착시 자극의 밝기 지각에 미치는 영향을 검증하는 것이다. 실험 1은 White 착시 자극을 변형한 Howe (2005)의 자극을 사용하여 양안시차와 단안정보인 T-교차 및 규칙적 구조 정보가 소속성에 대하여 불일치한 정보를 가질 때 대상의 밝기 지각이 주로 단안 정보에 의해 결정됨을 발견하였다. 실험 2는 규칙적 구조 정보와 양안시차만 포함하는 자극을 사용하여 T-교차가 존재하지 않을 때 두 정보 중 어느 하나가 주도적으로 밝기 지각을 결정하지 못함을 발견하였다. 본 연구의 실험 결과는 규칙적 구조와 양안시차가 대상의 소속성에 대하여 불일치한 정보를 제공할 때 T-교차가 대상의 소속성 결정에 중요한 정보로 이용되며 그에 따라 대상의 밝기 지각이 영향 받을 수 있음을 시사한다. The purpose of the research was to examine the relative effect of binocular disparity and T-junction on the determination of object"s belongingness in brightness perception when regular repeating structure was present in the stimuli. Using Howe"s stimuli, the variation of White illusion stimuli, Experiment 1 found that object"s belongingness was mainly determined by monocular information (T-junction as well as regular repeating structure) rather than by binocular disparity when both informations on belongingness were inconsistent. Experiment 2, using the stimuli employing only regular repeating structure and binocular disparity, found that object"s belongingness was not determined by any single information. These results imply that when the regular repeating structure and binocular disparity are inconsistent on object’s belongingness, T-junction plays an important role in the determination of the object’s belongingness and that the brightness perception is affected by it.

Mobile Robot Obstacle Avoidance Algorithms Based on Information Fusion of Vision and Sonar

Hongwei Gao,Qiuyang Wei,Yang Yu,Jinguo Liu 보안공학연구지원센터 2016 International Journal of Future Generation Communi Vol.9 No.8

In view of the problem of AS-R autonomous wheeled mobile robot obstacle avoidance, a rapid convergence of sonar and binocular stereovision sensor distance information in order to detect and avoid obstacle algorithm is proposed in this paper. The algorithm first uses binocular camera (CCD) to get three-dimensional image of the real environment, through the stereo matching and V-disparity method which is used to calculate disparity map, then obstacles is extracted by Hough lines detection algorithm, finally we will get information about obstacles and sonar return information with T-S fuzzy neural network fusion, then it will output walking controlled decisions. Experimental results proved that the algorithm is effective and practical.

Stereo Disparity Measurement for Binocular Stereo Video Systems

Kunio Takaya 제어로봇시스템학회 2009 제어로봇시스템학회 국제학술대회 논문집 Vol.2009 No.8

This paper reports the development of a stereo disparity measurement system by the binocular video camera. The system uses a simple optical configuration such that raster lines of the right and left cameras share the same vertical position. This allows 1D search alongthe rasters can line to match local patterns in the RGB color space. In order to deal with the occlusion, a strategy to minimize the number of line crossings among the lines connecting the pixel points in the right and left rasterlines. Small disparity for alarge distance to the object necessitates subpixel stereo matching. A method based on the phase-only cross correlation was in corporated. The system was developed for the Windows platform using VisualC++ and video OCXlibrary. The system is capable of displaying dense disparity maps continuously at a lower video rate.

The Relationship between Binocular Visual Function and Cybersickness by Vection in Virtual Reality

박인선,장정운 대한시과학회 2024 대한시과학회지 Vol.26 No.1

Purpose : This study aims to identify the correlation between binocular visual function and Cybersickness induced by vection in HMD VR content. Methods : The subjects were 52 adults aged 20 to 40 with no issues in near visual acuity. Binocular visual function and phoria, near point accommodation, near point convergence, binocular accommodation facility, stereo acuity, relative accommodation teat was assessed before the use of VR contents, and the subjects used three different VR contents categorized by optic flow. Cybersickness was measured with a virtual reality sickness questionnaire (VRSQ). A Pearson’s correlation coefficient was calculated to identify the linear relationship between the binocular visual function and the cybersickness using an alpha level of 0.50. Results : Content T and R showed a significant increase in cybersickness (p<0.001) for all items after using VR content. There was no significant difference in oculomotor discomfort for content B. Correlation analysis showed that near phoria was significantly correlated with disorientation (p<0.050) and total VRSQ (p<0.050) in Content T, and oculomotor discomfort (p<0.050) in Content R. The correlation analysis showed that oculomotor discomfort was significantly correlated with disorientation (p<0.050). The binocular accommodative facility was significantly correlated with the overall VRSQ of content T (p<0.050) No other binocular visual functions demonstrated a significant correlation with cybersickness components. Conclusion : As a result of cyber motion sickness, it is thought that the optical flow element of the content implementing 3D has a higher effect than the user's personal characteristics or the effect of the binocular function itself on cyber motion sickness. In future studies, it is thought that there is a need to consider the visual element and visual perception element of VR content.

입체영상에서 효율적 공간지각을 위한 광학합성 연구

김교완 한국일러스아트학회 2009 조형미디어학 Vol.12 No.2

Lately in the entertainment industry, various 3D images are released with the rising interests in 3d images. From blockbuster movies to animations, games, and publications; 3 dimensional movies that are focused on the visual experience are produced and released these days. Also, foundation of 3D broadcasting station and the advance of various types of displays are only a few examples of the proof that the 3d image has great potential for the future growth from the industrial point of view. It is expected that the 3D images will soon be generalized and applied in the various fields of industry in the foreseeable future. These 3d images are embodied by the visual perception through the binocular disparity, and it is essential that the optic senses to perceive the space in the 3d images. There is certain limitation when our brain to compound what we see. When our brain compounds the different kind of objects of the optic angle from the 3D movies that has an error within, it is possible that the error leads our brain to exceed its limitation and causes dizziness and also when the 3d movies require extreme motions, it might cause the ‘3d nausea’ to the user. This study is demonstrating the ideal space perception for the optic angle of the Binocular disparity that embodies 3d images by experiments. 최근 엔터테인먼트 분야에서 입체영상에 대한 관심이 고조되고 있으며 다양한 입체영상 콘텐츠들이 출시되고있다. 블록버스터 영화에서부터, 애니메이션, 게임, 출판물등에 이르기까지 시각적 체험을 중심으로 3D 입체영상이 제작 발표되고있다. 또한 입체방송국의 개국, 다양한 디스플레이 등 산업적인 관점에서도 입체영상에 대한 관심과 발전성은 매우 높다 할 수 있으며 향후 입체영상의 보편화와 더불어 보다 넓고 다양한 분야에서의 활용이 예견되고 있다. 이러한 입체 영상은 양안시차를 통한 시각적 지각에 의해 구현되고 있으며 입체영상에서의 광각이 공간을 지각하는 매우 중요한 요소로 작용한다. 잘못 제작되어진 입체영상의 경우 제작물내에 존재하는 여러 가지 목적물의 광각이 뇌에서 합성할 수 있는 한계를 초과하여 어지러움증을 유발하기도 하고 무리한 동작을 요구하는 장면이 계속될 경우 입체멀미를 하게된다. 본 연구에서는 입체영상을 구현하는 양안시차에서 최적의 공간지각을 위한 광각(수렴각)을 실험을 통해 입증하고자 한다.

입체 영상을 이용한 미디어 아트 기법 연구

김영은 차세대컨버전스정보서비스학회 2014 차세대컨버전스정보서비스기술논문지 Vol.3 No.2

미술작품에서 공간을 표현하기 위한 시도는 오래전부터 시작되었으며, 원근법등의 단안시적 요소들이 적용된 미술작품은 쉽게 찾아볼 수 있다. 단안시적 요소는 후천적인 경험에 의하여 공간감을 느낄 수 있도록 하며, 인간의 두 눈의 위상차로부터 발생하는 양안시적 요소는 뇌로부터 공간감을 느끼게 한다. 양안시차를 적용하여 사람에게 전달할 수 있는 기술 및 장비들이 개발됨에 따라 영화 및 방송에서 사용되고 있으며, 이러한 입체영상 기술은 미디어아트에도 적용되어 작가에게는 공간을 표현할 수 있는 표현의 확장을 가져왔으며, 관객들도 작품으로부터 입체감과 같은 새로운 경험을 할 수 있게 되었다. 본 연구에서는 미디어 아트에서 사용되고 있는 입체 영상 기술과 미디어아트 작품을 살펴봄으로써 입체영상기술이 다양한 분야로 융합하고 있음을 살펴보았다. The representation of space had been tried in the art for a long time. There are monocular and binocular visions to express a sense of space. The monocular vision is obtained by acquired experience and traditional artworks used monocular factors such as linear perspective to display in the image plane. The binocular vision uses the binocular disparity that make a sense of space from brain. As the development of technology and equipments to transfer the binocular disparity, the technology has been used in film and broadcasting. The stereoscopic technology is applied to the media art and brings the expansion of the expression to represent a space for artists. The audience is able to experience new feelings such as spatial artwork. In this paper, stereoscopic technology is studied in the arts by investigating stereoscopic techniques and media artworks.