안드로이드 환경에서의 적외선 영상 기반 불법 촬영 카메라 탐지 센서 모듈 개발

김문년,김성영,이형만,홍성민 한국센서학회 2022 센서학회지 Vol.31 No.2

Crimes related to illegal cameras are steadily increasing and causing social problems. Owing to the development of camera technology, the miniaturization and high performance of illegal cameras have caused anxiety among many people. This study is for detecting hidden cameras effectively such that they could not be easily detected by human eyes. An image sensor-based module with 940 nm wavelength infrared detection technology was developed, and an image processing algorithm was developed to selectively detect illegal cameras. Based on the Andr+R4oid smartphone environment, image processing technology was applied to an image acquired from an infrared camera, and a detection sensor module that is less sensitive to ambient brightness noise was studied. Experiments and optimization studies were conducted according to the Gaussian blur size, adaptive threshold size, and detection distance. The performance of the infrared image-based illegal camera detection sensor module was excellent. This is expected to contribute to the prevention of crimes related to illegal cameras.

무인기 탑재 열화상(IR) 센서의 농작물 대상 최적 활용 방안 연구

손호웅 ( Ho-woong Shon ),김태훈 ( Tae-hoon Kim ),이희우 ( Hee-woo Lee ) 한국산업융합학회 2023 한국산업융합학회 논문집 Vol.26 No.6

Thermal sensors, also called thermal infrared wavelength sensors, measure temperature based on the intensity of infrared signals that reach the sensor. The infrared signals recognized by the sensor include infrared wavelength(0.7∼3.0μm) and radiant infrared wavelength(3.0∼100μm). Infrared(IR) wavelengths are divided into five bands: near infrared(NIR), shortwave infrared(SWIR), midwave infrared(MWIR), longwave infrared(LWIR), and far infrared(FIR). Most thermal sensors use the LWIR to capture images. Thermal sensors measure the temperature of the target in a non-contact manner, and the data can be affected by the sensor's viewing angle between the target and the sensor, the amount of atmospheric water vapor (humidity), air temperature, and ground conditions. In this study, the characteristics of three thermal imaging sensor models that are widely used for observation using unmanned aerial vehicles were evaluated, and the optimal application field was determined.

High-sensitivity NIR Sensing with Stacked Photodiode Architecture

성현준,김윤경 한국광학회 2023 Current Optics and Photonics Vol.7 No.2

Near-infrared (NIR) sensing technology using CMOS image sensors is used in many applications, including automobiles, biological inspection, surveillance, and mobile devices. An intuitive way to improve NIR sensitivity is to thicken the light absorption layer (silicon). However, thickened silicon lacks NIR sensitivity and has other disadvantages, such as diminished optical performance (e.g. crosstalk) and difficulty in processing. In this paper, a pixel structure for NIR sensing using a stacked CMOS image sensor is introduced. There are two photodetection layers, a conventional layer and a bottom photodiode, in the stacked CMOS image sensor. The bottom photodiode is used as the NIR absorption layer. Therefore, the suggested pixel structure does not change the thickness of the conventional photodiode. To verify the suggested pixel structure, sensitivity was simulated using an optical simulator. As a result, the sensitivity was improved by a maximum of 130% and 160% at wavelengths of 850 nm and 940 nm, respectively, with a pixel size of 1.2 μm. Therefore, the proposed pixel structure is useful for NIR sens-ing without thickening the silicon.

Development of PKNU3: A small-format, multi-spectral, aerial photographic system

Lee Eun-Khung,Choi Chul-Uong,Suh Yong-Cheol The Korean Society of Remote Sensing 2004 大韓遠隔探査學會誌 Vol.20 No.5

Our laboratory originally developed the compact, multi-spectral, automatic aerial photographic system PKNU3 to allow greater flexibility in geological and environmental data collection. We are currently developing the PKNU3 system, which consists of a color-infrared spectral camera capable of simultaneous photography in the visible and near-infrared bands; a thermal infrared camera; two computers, each with an 80-gigabyte memory capacity for storing images; an MPEG board that can compress and transfer data to the computers in real-time; and the capability of using a helicopter platform. Before actual aerial photographic testing of the PKNU3, we experimented with each sensor. We analyzed the lens distortion, the sensitivity of the CCD in each band, and the thermal response of the thermal infrared sensor before the aerial photographing. As of September 2004, the PKNU3 development schedule has reached the second phase of testing. As the result of two aerial photographic tests, R, G, B and IR images were taken simultaneously; and images with an overlap rate of 70% using the automatic 1-s interval data recording time could be obtained by PKNU3. Further study is warranted to enhance the system with the addition of gyroscopic and IMU units. We evaluated the PKNU 3 system as a method of environmental remote sensing by comparing each chlorophyll image derived from PKNU 3 photographs. This appraisement was backed up with existing study that resulted in a modest improvement in the linear fit between the measures of chlorophyll and the RVI, NDVI and SAVI images stem from photographs taken by Duncantech MS 3100 which has same spectral configuration with MS 4000 used in PKNU3 system.

Development of PKNU3: A small-format, multi-spectral, aerial photographic system

Yong Cheol Suh,Eun Khung Lee,Chul Uong Choi 大韓遠隔探査學會 2004 大韓遠隔探査學會誌 Vol.20 No.5

Our laboratory originally developed the compact, multi-spectral, automatic aerial photographic system PKNU3 to allow greater flexibility in geological and environmental data collection. We are currently developing the PKNU 3 system, which consists of a color-infrared spectral camera capable of simultaneous photography in the visible and near-infrared bands; a thermal infrared camera; two computers, each with an 80-gigabyte memory capacity for storing images; an MPEG board that can compress and transfer data to the computers in real-time; and the capability of using a helicopter platform. Before actual aerial photographic testing of the PKNU3, we experimented with each sensor. We analyzed the lens distortion, the sensitivity of the CCD in each band, and the thermal response of the thermal infrared sensor before the aerial photographing. As of September 2004, the PKNU3 development schedule has reached the second phase of testing. As the result of two aerial photographic tests, R, G, Band IR images were taken simultaneously; and images with an overlap rate of 70% using the automatic 1-s interval data recording time could be obtained by PKNU3. Further study is warranted to enhance the system with the addition of gyroscopic and IMU units. We evaluated the PKNU 3 system as a method of environmental remote sensing by comparing each chlorophyll image derived from PKNU 3 photographs. This appraisement was backed up with existing study that resulted in a modest improvement in the linear fit between the measures of chlorophyll and the RVI, NDVI and SAVI images stem from photographs taken by Duncantech MS 3100 which has same spectral configuration with MS 4000 used in PKNU3 system.

다중센서 기반 서리관측 시스템의 개선: MFOS v2

김수현,이승재,김규랑 한국농림기상학회 2023 한국농림기상학회지 Vol.25 No.3

본 연구는 개선된 ‘다중센서 기반 무인 서리관측시스템(MFOS, Multiple-sensor based Frost Observation System)’을 소개하였다. 개선된 시스템인 MFOS v2는 엽면습윤센서를 기반으로 서리 감지는 물론, 서리 발생 주요 인자인 표면온도 예측을 위한 기능도 겸한다. 기존 관측 시스템은 1) 엽면습윤센서 표면이 대부분의 가시광선을 반사하기 때문에 RGB 카메라로 엽면습윤 센서 촬영 시 표면에 발생한 얼음(서리) 관측이 어려움, 2) 일출 전과 후에 RGB 카메라 촬영 결과가 어두움, 3) 열적외선 카메라가 온도의 상대적인 고저만을 보여주는 단점들이 존재하였다. 엽면습윤센서 표면에 발생한 얼음(서리) 파악을 위해 검정색으로 표면 도색 된 엽면습윤센서를 추가 설치하였고, 동일한 높이에 유리판들을 설치하여 얼음(서리) 발생 확인을 위한 보조 도구로 활용하였다. 일출 전과 후에 RGB 카메라 촬영을 위해 카메라 촬영 시간에 맞춰 전원이 On/Off 되도록 LED 조명을 연동시켜 설치하였다. 상대적인 온도의 높고 낮음 판단만 가능했던 기존의 열적외선 카메라도 픽셀당 온도 값 추출이 가능하도록 개선하였다. 이러한 개선 사항들을 반영한 MFOS v2는 실제 농경지에 설치하여 운영 중이며, 서리예측 모델에 들어갈 입력자료를 생산하는 진보된 서리 관측시스템으로서 중요한 역할을 할 것으로 기대된다. This study aimed to supplement the shortcomings of the Multiple-sensor-based Frost Observation System (MFOS). The developed frost observation system is an improvement of the existing system. Based on the leaf wetness sensor (LWS), it not only detects frost but also functions to predict surface temperature, which is a major factor in frost occurrence. With the existing observation system, 1) it is difficult to observe ice (frost) formation on the surface when capturing an image of the LWS with an RGB camera because the surface of the sensor reflects most visible light, 2) images captured using the RGB camera before and after sunrise are dark, and 3) the thermal infrared camera only shows the relative high and low temperature. To identify the ice (frost) generated on the surface of the LWS, a LWS that was painted black and three sheets of glass at the same height to be used as an auxiliary tool to check the occurrence of ice (frost) were installed. For RGB camera shooting before and after sunrise, synchronous LED lighting was installed so the power turns on/off according to the camera shooting time. The existing thermal infrared camera, which could only assess the relative temperature (high or low), was improved to extract the temperature value per pixel, and a comparison with the surface temperature sensor installed by the National Institute of Meteorological Sciences (NIMS) was performed to verify its accuracy. As a result of installing and operating the MFOS v2, which reflects these improvements, the accuracy and efficiency of automatic frost observation were demonstrated to be improved, and the usefulness of the data as input data for the frost prediction model was enhanced.

적외선센서와 카메라를 이용한 자율주행로봇의 장애물회피 알고리즘 연구

손정우,윤호성,임완수 한국융합신호처리학회 2023 융합신호처리학회 논문지 (JISPS) Vol.24 No.4

This paper proposes an algorithm for autonomous mobile robots to effectively navigate obstacles. In order to detect obstacles infrared sensors and cameras are employed. The infrared sensor is utilized to calculate the distance to obstacles while the captured images from the camera are used to determine the width of obstacles. To compute obstacle width, binary image processing, contour detection, and the minimum area rectangle technique are employed. Using the distance to obstacles and obstacle width, the avoidance angle is calculated, and this angle is incorporated into steering control. The proposed obstacle avoidance algorithm was implemented on an autonomous robot, and experimental results demonstrated a maximum reduction in avoidance time by 8.5 seconds compared to using only infrared sensors when the obstacle width is 30cm.

다센서 융합에 의한 강건한 모바일 로봇 개발

이영석(Young-Seok Lee),황헌(Heon Hwang) 산업기술교육훈련학회 2011 산업기술연구논문지 (JITR) Vol.16 No.1

본 연구에서는 미지의 환경 속에서도 근접 센서, 초음파 센서, 적외선 센서 그리고 영상 센서와 같은 여러 가지센서들을 이용해 주행 할 수 있는 모바일 로봇을 개발하였다. 일반적으로 인간의 감각기관의 기능은 곤충이나 다른 동물들보다 그 성능이 떨어진다. 그렇지만 사람이 비록 환경에 대해 상대적으로 부정확한 정보를 얻는다 할지라도, 인간이 지능적이며 환경변화에 강인한 행동을 할 수 있는 것은 얻어진 정보들의 효과적인 융합 처리를 거치기 때문이다. 이와 같이 다소 부정확한 정보라 할지라도 지능적 융합처리를 거치면 환경 변화에 대처가 가능하다는 사실이 본 연구의 동기가 되었다. 본 연구에서, 개발된 로 봇은 저렴한 센서들로부터의 정보들을 융합하여 여러 환경변화에도 주행 할 수 있는지가 실험되었다. 본 연구의 목적은 개발된 로봇이 건물 내에서 청소 또는 안내를 하거나 혹은 밭에서 작물이나 환경에대한 정보를 수집할 수 있게 하는 것이다. 센서들을 통해 얻어진 데이터들은 블루투스 통신을 통하여 메인 컴퓨터로 전송된다. 매인 컴퓨터는 전송된 정보들과 영상을 처리하여 모바일 로봇에 모터를 제어할 수있는 신호를 보내고 또한 모바일 로봇의 카메라의 기울어짐도 조절하게 된다. 개발된 로봇은 무선으로 제어가 되고, 비상시에는 수동으로 원격 조정기에 의해 제어된다. 비록 장애 환경에서 신호 전송에 몇몇 문제들은 있지만 저렴한 상용 센서들을 사용한 무선 제어 모바일 로봇을 개발하였다.

열적외선 이미지를 이용한 영상 처리

정병조(Jeong, Byoung-Jo),장성환(Jang, Seong-Whan) 한국산학기술학회 2009 한국산학기술학회논문지 Vol.10 No.7

본 논문은 열적외선 카메라 이미지를 영상 처리 기법을 활용하여 실시간으로 구현하는데 그 목적이 있다. 열적외선 영상 데이터는 온도의 변화에 따라 Hot Mapping, Cool Mapping, Rainbow Mapping을 하였으며, 열적외선 이미지의 명암대비 기능을 알아보기 위해 히스토그램 영상처리 기법을 사용하였고, 물체의 구분을 위해서 열적외선 이미지의 에지 부분을 추출하였다. 또한 이미지에서 온도를 추출해 내기 위해 이미지 정보 프로그램을 만들어 온도를 측정할 수 있었다. This study applied image processing techniques, constructed to real-time, to thermal infrared camera image. Thermal infrared image data was utilized for hot mapping, cool mapping, and rainbow mapping according to changing temperature. It was histogram image processing techniques so that detected shade contrast function of the thermal infrared image, and the thermal infrared image's edge was extracted to classification of object. Moreover, extraction of temperature from image was measured by using the image information program.

Temperature Measurement of Photovoltaic Modules Using Non-Contact Infrared System

Jovanovic, Ugljesa,Mancic, Dragan,Jovanovic, Igor,Petrusic, Zoran The Korean Institute of Electrical Engineers 2017 Journal of Electrical Engineering & Technology Vol.12 No.2

This paper presents temperature measurement of solar photovoltaic modules using the custom-made system composed of an infrared temperature sensor and a microcontroller. The obtained measurement results are processed, displayed and stored on a PC using the custom-made virtual instrument. The proposed system overcomes some of the problems related to the contact sensor application, and at the same time offers accurate readings and better flexibility. The proposed system is especially suitable for applications where the cost is a limiting factor in the choice of measuring system. The conducted analysis and the obtained results have shown an excellent accuracy of the proposed system in comparison to a high quality thermal imaging camera used as the reference instrument.