Vision Sensor Technology Trends for Industrial Inspection System

다국어 초록 (Multilingual Abstract)

The fourth industrial revolution is rapidly emerging as a new innovation trend for industrial automation. Accordingly, the demand for inspection equipment is highly increasing and vision sensor technologies are continuously evolving. Machine vision algorithms applied to deep learning are also being rapidly developed to maximize the performance of inspection equipment. In this review, we highlight the recent progress of vision sensor technology for the industrial inspection system. In particular, inspection principles and industrial applications of a vision sensor are classified according to the vision scanning methods. We also discuss machine vision-based inspection techniques containing rule- and deep learning-based image processing algorithms. We believe that this review provides novel approaches for various inspection fields of agriculture, medicine, and manufacturing industries.

참고문헌 (Reference)

1 Roh, Y. J., "Visual Inspection System with Flexible Illumination and Autofocusing" 463-475, 2002

2 Yang, J., "Using Deep Learning to Detect Defects in Manufacturing : A Comprehensive Survey and Current Challenges" 13 (13): 2020

3 Cai, Z., "Unfocused Plenoptic Metric Modeling and Calibration" 27 (27): 20177-20198, 2019

4 Lemstrom, G. F., "True RGB Line-Scan Camera for Color Machine Vision Applications" 2353 : 494-502, 1994

5 Schrey, O., "Tri-Linear Color Multi-Linescan Sensor with 200 kHz Line Rate" 125 : 220-226, 2016

6 Semeniuta, O., "Towards Increased Intelligence and Automatic Improvement in Industrial Vision Systems" 67 : 256-261, 2018

7 González, A. B., "The Industrial Camera Modules Market : Market Review and Forecast until 2022" 16 (16): 24-26, 2019

8 Jiang, J., "Surface Defect Detection for Mobile Phone Back Glass based on Symmetric Convolutional Neural Network Deep Learning" 10 (10): 2020

9 Clancy, N. T., "Spectrally Encoded Fiber-Based Structured Lighting Probe for Intraoperative 3D Imaging" 2 (2): 3119-3128, 2011

10 김동현, "Smart Machining Process Using Machine Learning: A Review and Perspective on Machining Industry" 한국정밀공학회 5 (5): 555-568, 2018

11 Guo, H., "Single-Shot Digital Phase-Shifting Moiré Patterns for 3D Topography" 60 (60): 84-92, 2021

12 Hochman, G., "Restoration of Images Captured by a Staggered Time Delay and Integration Camera in the Presence of Mechanical Vibrations" 43 (43): 4345-4354, 2004

13 Zhang, S., "Recent Progresses on Real-Time 3D Shape Measurement Using Digital Fringe Projection Techniques" 48 (48): 149-158, 2010

14 He, Y., "Recent Advances in 3D Data Acquisition and Processing by Time-of-Flight Camera" 7 : 12495-12510, 2019

15 Schmidt, J., "Recent Advances and Applications of Machine Learning in Solid-State Materials Science" 5 (5): 1-36, 2019

16 Xu, J., "Rapid 3D Surface Profile Measurement of Industrial Parts Using TwoLevel Structured Light Patterns" 49 (49): 907-914, 2011

17 Salvi, J., "Pattern Codification Strategies in Structured Light Systems" 37 (37): 827-849, 2004

18 Rivas-Lopez, M., "Optoelectronics in Machine VisionBased Theories and Applications"

19 Yang, S. -P., "Optical MEMS Devices for Compact 3D Surface Imaging Cameras" 7 (7): 1-9, 2019

20 Mezgec, S., "NutriNet : A Deep Learning Food and Drink Image Recognition System for Dietary Assessment" 9 (9): 2017

21 Brückner, P., "Novel Approach on Optical Analysis and Multichannel Sorting of Grain Samples" 1-4, 2015

22 Li, E., "MultiFrequency and Multiple Phase-Shift Sinusoidal Fringe Projection for 3D Profilometry" 13 (13): 1561-1569, 2005

23 Mavridou, E., "Machine Vision Systems in Precision Agriculture for Crop Farming" 5 (5): 2019

24 Wang, J., "Machine Vision Intelligence for Product Defect Inspection based on Deep Learning and Hough Transform" 51 : 52-60, 2019

25 Nandi, C., "Machine Vision Based Techniques for Automatic Mango Fruit Sorting and Grading based on Maturity Level and Size" 8 : 27-46, 2014

26 Zancul, E., "Machine Vision Applications in a Learning Factory" 45 : 516-521, 2020

27 Coffey, V. C., "Machine Vision : The Eyes of Industry 4. 0" 29 (29): 42-49, 2018

28 Ng, R., "Light Field Photography with a Hand-Held Plenoptic Camera" Stanford University 1-11, 2005

29 Bloss, R., "Latest in Vision Sensor Technology As Well As Innovations in Sensing, Pressure, Force, Medical, Particle Size and Many Other Applications" 37 (37): 7-11, 2017

30 Li, B., "HighAccuracy, High-Speed 3D Structured Light Imaging Techniques and Potential Applications to Intelligent Robotics" 1 (1): 86-103, 2017

31 Bodenstorfer, E., "High-Speed Line-Scan Camera with Multi-Line CMOS Color Sensor" 9-14, 2012

32 Bodenstorfer, E., "High-Speed Line-Scan Camera with Digital Time Delay Integration" 2007

33 Bae, S. I., "High Contrast Ultrathin Light-Field Camera Using Inverted Microlens Arrays with Metal-Insulator-Metal Optical Absorber" 9 (9): 2021

34 Martínez-Corral, M., "Fundamentals of 3D Imaging and Displays : A Tutorial on Integral Imaging, LightField, and Plenoptic Systems" 10 (10): 512-566, 2018

35 Chen, F., "Full-Field 3D Measurement Using Multi-Camera Digital Image Correlation System" 51 (51): 1044-1052, 2013

36 Fu, K., "Fast Spatial-Temporal Stereo Matching for 3D Face Reconstruction under Speckle Pattern Projection" 85 : 36-45, 2019

37 Hosni, A., "Fast Cost-Volume Filtering for Visual Correspondence and Beyond" 35 (35): 504-511, 2012

38 Jang, K. -W., "Electrothermal MEMS Parallel Plate Rotation for SingleImager Stereoscopic Endoscopes" 24 (24): 9667-9672, 2016

39 Monica, R., "Detection of Parcel Boxes for Pallet Unloading Using a 3D Time-of-Flight Industrial Sensor" 314-318, 2020

40 Niclass, C., "Design and Characterization of a 256 x 64-Pixel Single-Photon Imager in CMOS for a MEMS-Based Laser Scanning Time-ofFlight Sensor" 20 (20): 11863-11881, 2012

41 Štolc, S, "Depth and All-in-Focus Imaging by a Multi-Line-Scan LightField Camera" 23 (23): 2014

42 Zeller, N., "Depth Estimation and Camera Calibration of a Focused Plenoptic Camera for Visual Odometry" 118 : 83-100, 2016

43 He, Y., "Depth Errors Analysis and Correction for Time-of-Flight(ToF)Cameras" 17 (17): 2017

44 Fujiyoshi, H., "Deep LearningBased Image Recognition for Autonomous Driving" 43 (43): 244-252, 2019

45 O’Mahony, N., "Deep Learning vs. Traditional Computer Vision" 943 : 128-144, 2019

46 Li, L., "Deep Learning for Smart Industry : Efficient Manufacture Inspection System with Fog Computing" 14 (14): 4665-4673, 2018

47 Chen, A. I., "Deep Learning Robotic Guidance for Autonomous Vascular Access" 2 (2): 104-115, 2020

48 Yang, S. -P., "Compact Stereo Endoscopic Camera Using Microprism Arrays" 41 (41): 1285-1288, 2016

49 Švaco, M, "Calibration of an Industrial Robot Using a Stereo Vision System" 69 : 459-463, 2014

50 Ma, L., "Blister Defect Detection based on Convolutional Neural Network for Polymer Lithium-Ion Battery" 9 (9): 2019

51 Wei, S., "Binocular Vision Measurement Using Dammann Grating" 54 (54): 3246-3251, 2015

52 Wan, J., "Artificial Intelligence for Cloud-Assisted Smart Factory" 6 : 55419-55430, 2018

53 Kalsoom, T., "Advances in Sensor Technologies in the Era of Smart Factory and Industry 4. 0" 20 (20): 2020

54 Hussmann, S., "A Review on Commercial Solid State 3D Cameras for Machine Vision Applications" 1 : 303-351, 2013

55 Fu, G., "A DeepLearning-Based Approach for Fast and Robust Steel Surface Defects Classification" 121 : 397-405, 2019

56 Yuan-Fu, Y., "A Deep Learning Model for Identification of Defect Patterns in Semiconductor Wafer Map" 1-6, 2019

57 이주연, "A Big Data Analytics Platform for Smart Factories in Small and Medium-Sized Manufacturing Enterprises: An Empirical Case Study of a Die Casting Factory" 한국정밀공학회 18 (18): 1353-1361, 2017

58 Raytrix, "3D Light-Field Vision, Depth Sensors, Plenoptic Metrology"