깊이 정보를 이용한 영역분할 기반의 다시점 영상 조명보상 기법 = Illumination Compensation Algorithm based on Segmentation with Depth Information for Multi-view Image

다국어 초록 (Multilingual Abstract)

In this paper, a new illumination compensation algorithm by segmentation with depth information is proposed to improve the coding efficiency of multi-view images. In the proposed algorithm, a reference image is first segmented into several layers where each layer is composed of objects with a similar depth value. Then we separate objects from each other even in the same layer by labeling each separate region in the layered image. Then, the labeled reference depth image is converted to the position of the distortion image view by using 3D warping algorithm. Finally, we apply an illumination compensation algorithm to each of matched regions in the converted reference view and distorted view. The occlusion regions that occur by 3D warping are also compensated by a global compensation method. Through experimental results, we are able to confirm that the proposed algorithm has better performance to improve coding efficiency.

참고문헌 (Reference)

1 황선규, "영상 처리 프로그래밍 by Visual C++" 한빛미디어 2007

2 박성희, "다시점 비디오의 색상 성분 보정을 위한 특징점 기반의 전처리 방법" 한국정보통신학회 15 (15): 2527-2533, 2011

3 "http://mpeg.chiariglione.org/standards.htm"

4 S. Yea, "View synthesis prediction for multiview video coding" 24 : 89-100, 2009

5 Y. Mori, "View generation with 3D warping using depth information for FTV" 24 (24): 65-72, 2009

6 Y. Mori, "View generation with 3D warping using depth information for FTV" 24 : 65-72, 2009

7 U. Fecker, "Timeconstant histogram matching for colour compensation of multi-view video sequences" 2007

8 "Test model under consideration for HEVC based 3D video coding v3.0"

9 "Test model for AVC-based 3D video coding v2.0"

10 J. H. Kim, "New coding tools for illumination and focus mismatch compensation in multiview video coding" 17 (17): 1519-1534, 2007

11 M. Gilge, "Motion estimation by scene adaptive block matching and illumination correction, In Image Process" Image Process. Algorithms and Techni., R. J. Moorhead and K. S. Pennington, Eds., Canada 355-366, 1990

12 Joint Video Team, "Joint draft 3 Multi-view video coding"

13 "Introduction to 3D video"

14 Dong-Seok Lee, "Illumination compensation for multi-view video based on layered histogram matching with depth information" 286 : 74-84, 2013

15 U. Fecker, "Histogram-based pre-filtering for luminance and chrominance compensation of multi-view video" 18 (18): 1258-1267, 2008

16 "H. 264 Advanced Video Coding for Generic Audiovisual Services"

17 K. Kamikura, "Global brightness-variation compensation for video coding" 8 (8): 988-1000, 1998

18 M. Tanimoto, "Free-viewpoint TV" 28 : 67-76, 2011

19 C. Lee, "Efficient multiview depth video coding using depth synthesis prediction" 50 (50): 1-14, 2011

20 Y. Su, "Common test conditions for multiview video coding"

21 "Call for proposals on 3D video coding technology"

22 J. Lopez, "Block-based illumination compensation and search techniques for multiview video coding" 2004

23 "Applications and Requirments on FTV"

24 P. L. Lai, "Adaptive Reference Filtering for MVC" 21-27, 2007

25 D. Scharstein, "A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms" 131-140, 2001

26 H. Schwarz, "3D video coding using advanced prediction Depth modeling, and encoder control methods" 1-4, 2012