3차원 손 특징을 이용한 손 동작 인식에 관한 연구 = A study on hand gesture recognition using 3D hand feature

국문 초록 (Abstract)

본 논문에서는 3차원 손 특징 데이터를 이용한 동작 인식 시스템을 제안하고자 한다. 제안된 시스템은 3차원 센서에 의해 조밀한 범위의 영상을 생성하여 손 동작에 대한 3차원 특징을 추출하여 손 동작을 분류한다. 또한 다양한 조명과 배경하에서의 손을 견실하게 분할하고 색상 정보와 상관이 없어 수화와 같은 복잡한 손 동작에 대해서도 견실한 인식능력을 나타낼 수가 있다. 제안된 방법의 전체적인 순서는 3차원 영상 획득, 팔 분할, 손과 팔목 분할, 손 자세 추정, 3차원 특징 추출, 그리고 동작 분류로 구성되어 있고, 수화 자세에 대한 인식 실험으로 제안된 시스템의 효율성을 입증하였다.

다국어 초록 (Multilingual Abstract)

In this paper a gesture recognition system using 3D feature data is described. The system relies on a novel 3D sensor that generates a dense range mage of the scene. The main novelty of the proposed system, with respect to other 3D gesture recognition techniques, is the capability for robust recognition of complex hand postures such as those encountered in sign language alphabets. This is achieved by explicitly employing 3D hand features. Moreover, the proposed approach does not rely on colour information, and guarantees robust segmentation of the hand under various illumination conditions, and content of the scene. Several novel 3D image analysis algorithms are presented covering the complete processing chain: 3D image acquisition, arm segmentation, hand -forearm segmentation, hand pose estimation, 3D feature extraction, and gesture classification. The proposed system is tested in an application scenario involving the recognition of sign-language postures.

참고문헌 (Reference)

1 "Visual interpretation of hand gestures for human-computer interaction IEEE transactions on pattern analysis and machine intelligence" 9 (9): 677-695, 1997.

2 "The Visual Analysis of Human Movement" 3 (3): 82-98, 1999.

3 "Stereo based gesture recognition invariant to 3d pose and lighting in Proc. IEEE Conference on Computer Vision and Pattern Recognition" me 1 : 2000.

4 "Robust finger tracking with multiple cameras" and tracking of faces and gestures in real-time systems : 1999.

5 "Real-time 3d and color camera" myko (myko): 2001

6 "Pattern Classification." 2001.

7 "Multiple hand gesture tracking using multiple cameras" 1999.

8 "Model-based articulated hand motion tracking for gesture recognition" 6 (6): 121-134, 1998.

9 "Detection and estimation of pointing gestures in dense disparity maps in Proc. Fourth IEEE International Conference on Automatic Face and Gesture Recognition" 2000.