Neural-Network Model for Compensation of Lens Distortion in Camera Calibration

다국어 초록 (Multilingual Abstract)

Camera calibration for machine vision is critical in three-dimensional (3-D) measurement systems based on a digital light processing (DLP) projector and a camera. The Z-height of the measurement point is calculated using the phase value observed by the camera when a fringe pattern is scanned from a projection onto an object. On the other hand, the X and Y coordinates are obtained from the camera coordinates using a transformation matrix, and the mathematical model for lens distortion is additionally used. However, the errors for x and y coordinates are 10 times larger than the z-height error in an experiment. This is because the lens distortion is not sufficiently compensated in the mathematical model considering only the position from the lens center. Therefore, the neural network (NN) model that considers the measurement distance in addition to the position is proposed in this paper. Experiments were conducted on a 100 × 100 mm2 area, and a maximum error of 0.5 mm is observed for the mathematical model. However, when the NN model considering the height of the object is used, the error is reduced by 60% to 0.2 mm.

참고문헌 (Reference)

1 Du, H., "Three-Dimensional Shape Measurement with an Arbitrarily Arranged Fringe Projection Profilometry System" 32 (32): 2438-2440, 2007

2 Ganotra, D., "Profilometry for the Measurement of Three-Dimensional Object Shape Using Radial Basis Function, and Multi-layer Perceptron Neural Networks" 209 : 291-301, 2002

3 Chen, F., "Overview of Three-Dimensional Shape Measurement Using Optical Methods" 39 (39): 10-22, 2000

4 Li, B., "Novel Calibration Method for Structured Light System with an Out-of-Focus Projector" 53 (53): 3415-3426, 2014

5 Beale, M, Hagan, M., "Neural Network Toolbox, User's Guide" Mathworks 3.1-30, 2017

6 Chung, B., "Neural Network Model for Phase-Height Relationship of Each Image Pixel in 3D Shape Measurement by Machine Vision" 44 (44): 587-599, 2014

7 Yan, T., "Neural Network Applied to Reconstruction of Complex Objects Based on Fringe Projection" 278 : 274-278, 2007

8 Wasser, P., "Neural Computing: Theory and Practice" Van Nostrand Reinhold 43-59, 1989

9 Huang, L., "Least-Squares Calibration Method for Fringe Projection Profilometry Considering Camera Lens Distortion" 49 (49): 1539-1548, 2010

10 Guo, H., "Least-Squares Calibration Method for Fringe Projection Profilometry" 44 (44): 033603-, 2005

11 Chung, B., "Improved Least-Squares Method for Phase-to-Height Relationship in Fringe Projection Profilometry" 12 (12): 1-11, 2016

12 Wei, G., "Implicit and Explicit Camera Calibration: Theory and Experiments" 16 (16): 469-480, 1994

13 Takeda, M., "Fourier Transform Profilometry for the Automatic Measurement of 3-D Object Shapes" 22 (22): 3977-3982, 1983

14 Zhang, Z., "Flexible Camera Calibration by Viewing a Plane from Unknown Orientations" 666-673, 1999

15 Jia, P., "Comparison of Linear and Nonlinear Calibration Methods for Phase-Measuring Profilometry" 46 : 2007

16 Weng, J., "Camera Calibration with Distortion Model and Accuracy Evaluation" 14 (14): 965-980, 1992

17 Liu, H., "Calibration-Based Phase-Shifting Projected Fringe Profilometry for Accurate Absolute 3D Surface Profile Measurement" 216 : 65-80, 2003

18 Tsai, R., "A Versatile Camera Calibration Technique for High-Accuracy 3D Machine Vision Metrology Using Off-the-Shelf TV Camera and Lenses" 3 (3): 323-344, 1987

19 Tian, A., "A Flexible New Three- Dimensional Measurement Technique by Projected Fringe Pattern" 38 : 585-589, 2006

20 Zhang, Z., "A Flexible New Technique for Camera Calibration" 22 (22): 1330-1334, 2000

21 Sansoni, G., "3D Vision Based on the Combination of Gray Code and Phase Shift Light Projection" 38 (38): 6565-6573, 1999

22 Li, W., "3D Shape Measurement Based on Structured Light Projection Applying Polynomial Interpolation Technique" 124 (124): 20-27, 2013