JND와 경계 보호 평탄화 필터를 이용한 휘도 및 색상 복원 = JND based Illumination and Color Restoration Using Edge-preserving Filter

국문 초록 (Abstract)

본 논문에서는 임의의 조명 상황에서 왜곡된 영상을 JND(Just noticeable difference)와 경계 보호 평탄화 필터(edge-preserving smoothing filter) 를 사용하여 자동적으로 휘도 및 색상을 복원 하는 기법을 제안한다. 제안된 방법은 최적의 휘도 보상, 선명한 색상 복원, 휘도 보상 시 발생되는 여러 가지 문제점의 최소화, 자동화된 매개변수 추정 그리고 하드웨어 구현을 위한 고속화 등을 목적으로 하고 있다. 이를 위하여 본 논문에서는 후광효과(HALO)나 노이즈 증폭 등의 눈에 거슬리는 결함을 제거하기 위하여 경계 보호 평탄화 필터의 효용성에 대해 보인다. 또한 제안된 색상 복원 함수는 인간시각에 근거해 자연스러운 색상의 복원과 왜곡된 색상의 보정을 수행한다. 자동화된 처리를 위하여 영상의 통계적 분석과 JND를 이용해 적합한 매개변수를 찾으며 모든 상수는 미리 정의되어 사용된다. 또한 터치스크린 카메라를 이용한 관심영역(ROI : Region of Interest) 기반 매개변수 추정기법을 사용하여 역광 사진 보정을 좀 더 효율적으로 수행한다. 객관적 평가를 위해 CMC, CIEde2000, PSNR, SSIM, 그리고 3D CIELAB 색역을 기존의 연구나 상업 제품들과 비교하였다.

다국어 초록 (Multilingual Abstract)

We present the framework for JND based Illumination and Color Restoration Using Edge-preserving filter for restoring distorted images taken under the arbitrary lighting conditions. The proposed method is effective for appropriate illumination compensation, vivid color restoration, artifacts suppression, automatic parameter estimation, and low computation cost for HW implementation. We show the efficiency of the mean shift filter and sigma filter for illumination compensation with small spread parameter while considering the processing time and removing the artifacts such as HALO and noise amplification. The suggested CRF (color restoration filter) can restore the natural color and correct color distortion artifact more perceptually compared with current solutions. For the automatic processing, the image statistics analysis finds suitable parameter using JND and all constants are pre-defined. We also introduce the ROI-based parameter estimation dealing with small shadow area against spacious well-exposed background in an image for the touch-screen camera. The object evaluation is performed by CMC, CIEde2000, PSNR, SSIM, and 3D CIELAB gamut with state-of-the-art research and existing commercial solutions.

목차 (Table of Contents)

• 요약
• Abstract
• Ⅰ. 서론
• Ⅱ. 기존의 방법
• Ⅲ. 경계 보호 평탄화 필터
• Ⅳ. JICR
• Ⅴ. ROI 기반 매개변수 예측
• Ⅵ. JND 기반 매개변수 예측
• Ⅵ. 실험 결과
• Ⅶ. 결론
• 참고문헌
• 저자소개

참고문헌 (Reference)

1 장인수, "이미지의 색도 분포를 고려한 다중 Retinex 기반의 칼라 향상 기법" 31 (31): 845-846, 2008

2 주명호, "레티넥스를 이용한 조명 변화 이미지 보상 기법" (2) : 555-556, 2007

3 C. Vyacheslav, "“Image processing method and computer software for image processing”, WO 2006/018658 A2.(861)"

4 "www.hdrsoft.com"

5 "www.gimp.org"

6 "www.adobe.com"

7 E. Provenzi, "spatially variant white-patch and gray-world method for color image enhancement driven by local contrast" 30 (30): 1757-1770, 2008

8 "http://imaging.nikon.com/products/imaging/ technology /d-technology /expeed /d_lighting /index.htm"

9 M. R. Luo, "The development of the CIE 2000 colour-difference formula: CIEDE2000" 26 : 340-350, 2001

10 M. Elad, "Retinex by two bilateral filters" 217-229, 2005

11 H. Y. Liu, "Region-based visual attention analysis with its application in. image browsing on small displays" 815-824, 2006

12 E. Provenzi, "Random spray retinex: a new Retinex implementation to investigate the local properties of the model" 16 : 162-171, 2007

13 D. J. Jobson, "Properties and performance of a center/surround Retinex" 6 (6): 451-462, 1997

14 C. Gatta, "Perceptually inspired HDR images tone mapping with color correction" 285-294, 2007

15 R. Bergman, "Perceptual segmentation: combining image segmentation with object tagging" 2008

16 R. Fattal, "Multiscale shape and detail enhancement from multi-light image collections" 26 (26): 2007

17 A. Beoldo, "Multiple cue adaptive tracking of deformable objects with particle filter dore" 237-240, 2008

18 D. Comaniciu, "Mean shift: a robust approach toward feature space analysis" 24 (24): 603-619, 2002

19 D. Comaniciu, "Mean shift analysis and applications" 1197-1203, 1999

20 S. Bo, "Luminance based MSR for color image enhancement" 3 : 358-362, 2008

21 A. G. Rempel, "Ldr2Hdr: on-the-fly reverse tone mapping of legacy video and photographs" 26 (26): 39-, 2007

22 D. Lischinski, "Interactive local adjustment of tonal values" 25 (25): 646-653, 2006

23 Y. Wong, "Image enhancement by edge-preserving filtering" 522-524, 1994

24 A. Iranli, "HVS-aware dynamic backlight scaling in TFT-LCDs" 14 : 1103-1116, 2006

25 A. Rizzi, "From Retinex to ACE: Issues in digital images unsupervised color equalization" 13 (13): 15-28, 2004

26 E. Eisemann, "Flash photography enhancement via intrinsic relighting" 23 (23): 673-678, 2004

27 V. Vonikakis, "Fast centre-surround contrast modification" 2 (2): 19-34, 2008

28 F. Durand, "Fast bilateral filtering for the display of high-dynamic-range images" 21 (21): 257-266, 2002

29 V. Vonikakis, "Fast automatic compensation of under/over-exposured image regions" PSIVT 2007

30 H. C, Han, "Face relighting based on virtual irradiance sphere and reflection coefficient" 47 (47): 2008

31 S. Paris, "Edge-preserving smoothing and mean-shift segmentation of video streams" 2 : 460-473, 2008

32 Z. Farbman, "Edge-preserving decompositions for multi-scale tone and detail manipulation" 27 (27): 2008

33 G. Petschnigg, "Digital photography with flash and. no-flash image pairs" 23 (23): 664-672, 2004

34 J. S. Lee, "Digital image smoothing and the sigma filter" 24 : 255-269, 1983

35 Y. M.Baek, "Color image enhancement using the laplacian pyramid" 760-769, 2006

36 D. H. Choi, "Color image enhancement using single-scale Retinex based on an improved image formation model" 2008

37 L. Meylan, "Color image enhancement using a Retinex based adaptive filter" 359-363, 2004

38 L. Meylan, "Bio-inspired color image enhancement" 5292 : P46-P56, 2004

39 C. Tomasi, "Bilateral filtering for gray and color images" 839-846, 1998

40 I. V. Safonov, "Automatic correction of amateur photos damaged by backlighting" Graphicon 2006

41 H. Han, "Automatic Illumination and Color Compensation Using Mean Shift and Sigma Filter" IEEE Trans. on Consumer Electronics , submitted for publication 2009

42 E. Land, "An alternative technique for the computation of the designator in the Retinex theory of color vision" 83 : 3078-3080, 1986

43 Z. Buyue, "Adaptive bilateral filter for sharpness enhancement and noise removal" 5 : 664-678, 2008

44 "AATCC Test Method 173-1998, “CMC: calculation of small color differences for acceptability,” AATCC Technical Manual"

45 D. J. Jobson, "A multi-Scale Retinex for bridging the gap between color images and the human observation of scenes" (7) : 965-976, 1997

46 W. Wang, "A fast multi-scale retinex algorithm for color image enhancement" 80-85, 2008

47 M. Ghazal, "A fast directional sigma filter for noise reduction in digital TV signals" 53 (53): 1500-1507, 2007

48 Z. Rahman, "A comparison of the multiscale Retinex with other image enhancement techniques" 426-431, 1997