Tracking the Joints of Arthropod Legs using Multiple Images and Inverse Kinematics

다국어 초록 (Multilingual Abstract)

Negligible research has been conducted on the systematic analysis of small animals, such as lizards and arthropods. Furthermore,few studies in the area use digitized data obtained from animals. Currently, the motion analysis of most living creatures is carriedout using optical motion capture systems. However, these systems are inapplicable to small animals because of the difficulty inattaching optical markers to them. Ongoing research on markerless motion capture technology aims to solve this problem, but mostof those studies have been conducted on human subjects. Therefore, more studies are needed to apply a markerless motion capturetechnology to insects with several legs and joints. In this paper, we propose a method to calculate the continuous pose of smallarticulated animals using multiple view video sequences. This includes the extraction of the initial skeleton model and the extractionof roots and extremities, as well as the calculation of joint kinematics using the Forward and Backward Reaching Inverse Kinematics(FABRIK) algorithm. We also generate the optimal three-dimensional skeleton model using the correction method in order to obtainthe position of the joints.

참고문헌 (Reference)

1 Cheung, K. M. G., "Visual Hull Construction, Alignment and Refinement for Human Kinematic Modeling, Motion Tracking and Rendering" Robotics Institute, Carnegie Mellon University 2003

2 Bai, X., "Skeleton Pruning by Contour Partitioning with Discrete Curve Evolution" 29 (29): 449-462, 2007

3 Lourakis, M. I., "SBA: A Software Package for Generic Sparse Bundle Adjustment" 36 (36): 2-, 2009

4 Endo, Y., "Reconstructing Individual Hand Models from Motion Capture Data" 1 (1): 1-12, 2014

5 Hoshino, R., "Real-Time Motion Capture System based-on Silhouette Contour Analysis and Inverse Kinematics" 7 : 157-163, 2001

6 Fujiyoshi, H., "Real-Time Human Motion Analysis by Image Skeletonization" 15-21, 1998

7 Caillette, F., "Real-Time 3-D Human Body Tracking using Variable Length Markov Models" 2005

8 Cappozzo, A., "Position and Orientation in Space of Bones during Movement:Anatomical Frame Definition and Determination" 10 (10): 171-178, 1995

9 Hwang, S., "Pose Estimation of Small-Articulated Animals using Multiple View Images" 2014

10 Hartley, R., "Multiple View Geometry in Computer Vision" Cambridge University Press 237-362, 2003

11 Corazza, S., "Markerless Motion Capture through Visual Hull, Articulated ICP and Subject Specific Model Generation" 87 (87): 156-169, 2010

12 Lourakis, M., "Levmar: Levenberg-Marquardt Nonlinear Least Squares Algorithms in C/C++"

13 Michoud, B., "Human Motion-Understanding, Modeling, Capture and Animation" 88-103, 2007

14 Frigo, C., "Functionally Oriented and Clinically Feasible Quantitative Gait Analysis Method" 36 (36): 179-185, 1998

15 Aristidou, A., "FABRIK: A Fast, Iterative Solver for the Inverse Kinematics Problem" 73 (73): 243-260, 2011

16 Correa Hernandez, P., "Dual Bayesian and Morphology-based Approach for Markerless Human Motion Capture in Natural Interaction Environments" 101 : 69-106, 2006

17 Pullar, K., "Development of a Model-based Tracking Algorithm for Reconstruction of 3d Spider Motion" 2008

18 Mundermann, L., "Conditions That Influence the Accuracy of Anthropometric Parameter Estimation for Human Body Segments using Shape-from-Silhouette" 5665 : 268-277, 2005

19 Park, C. J., "Blob Feature-based Markerfree Motion Capture System for Motion Interface of Game" 4 : 18-28, 2004

20 Vattam, S., "Biologically-Inspired Innovation in Engineering Design: A Cognitive Study" Georgia Institute of Technology 2007

21 Corazza, S., "Automatic Generation of a Subject-Specific Model for Accurate Markerless Motion Capture and Biomechanical Applications" 57 (57): 806-812, 2010

22 Deutscher, J., "Articulated Body Motion Capture by Stochastic Search" 61 (61): 185-205, 2005

23 Gibson, D. P., "A System for the Capture and Synthesis of Insect Motion" 69 (69): 231-245, 2007

24 Li, Y., "A Relaxation Algorithm for Real-Time Multiple View 3D-Tracking" 20 (20): 841-859, 2002

25 Corazza, S., "A Markerless Motion Capture System to Study Musculoskeletal Biomechanics: Visual Hull and Simulated Annealing Approach" 34 (34): 1019-1029, 2006

26 Davis, R. B., "A Gait Analysis Data Collection and Reduction Technique" 10 (10): 575-587, 1991