Optical Flow for Motion Images with Large Displacement by Functional Expansion

다국어 초록 (Multilingual Abstract)

One of the representative methods of optical flow is a gradient method which estimates the movement of an object based on the differential of image brightness. However, the method is ineffective for large displacement of the object and many improved methods have been proposed to copy with such limitations. One of these improved techniques is the multigrid processing, which is used in many optical flow algorithms. As an alternative novel technique we have been proposing an orthogonal functional expansion method, where whole displacements are expanded from low frequency terms. This method is expected to be applicable to flow estimation with large displacement and deformation including expansion and contraction, which are difficult to cope with by conventional optical flow methods. In the orthogonal functional expansion method, the apparent displacement field is calculated iteratively by a projection method which utilizes derivatives of the invariant constraint equations of brightness constancy. One feature of this method is that differentiation of the input image is not necessary, thereby reducing sensitivity to noise. In this paper, we apply our method to several real images in which the objects undergo large displacement and/or deformation including expansion. We demonstrate the effectiveness of the orthogonal functional expansion method by comparing with conventional methods including our optimally scaled multigrid optical flow algorithm.

참고문헌 (Reference)

1 "Systems and Experiment Performance of Optical Flow Techniques Int. Journal of Computer Vision" 43-77, 1994.

2 "Scene matching by hierarichical correlation IEEE Computer Society on Computer Vision and Pattern Recognition" 432-441, 1983.

3 "Robust tracking of position and velocity with Kalman snakes" 21 : 564-569, 2000.

4 "Resolving motion correspondence for densely moving points" 23 : 54-72, 2000.

5 "Real-time tracking of moving persons by exploiting spatio-temporal image slices" 22 : 797-808, 2000.

6 "On the estimation of optical flow Relations between different approaches and some new results" 299-324, 1987.

7 "On Convergence of the Horn and Schunck Optical-Flow Estimation Method" 13 : 848-852, 2004.

8 "Multilevel relaxation in low-level computer vision" Springer-Verlag 312-330, 1984.

9 "Multi-resolution flow through motion analysis Proceedings IEEE Computer Society on Computer Vision and Pattern Recognition" 246-252, 1983.

10 "Multi-level adaptive solutions to boundary-value problems Mathematics of Computations" 333-390, 1977.

11 "Investigation of multigrid algorithms for the estimation of optical flow fields in image sequences" 150-177, 1988.

12 "Image reconstruction error for optical flow" 73-80, 1994.

13 "Hermite expansions of compact support waveforms Applications to myoelectric signals IEEE Trans. on Biomedical Engineering" 1147-1159, 1994.

14 "General Approach to Block-matching Motion Estimation" 1464-1474, 1993.

15 "Contour matching using epipolar geometry" 22 : 358-370, 2000.

16 "Computing dense displacement fields with confidence measures in scenes containing occlusion" 184-, 1984.

17 "Computations underlying the measurement of visual motion" 309-354, 1984.

18 "Analysis techniques for image sequences" 1987.

19 "An investigation of smoothness constraints for the estimation of displacement vector fields from image sequences" 565-593, 1986.

20 "A scaled multigrid optical flow algorithm based on the least RMS error between real and estimated second images" 32 : 59-72, 1999

21 "A fast scalable algorithm for discontinuous optical flow estimation" 18 : 181-194, 1996.

22 "A computational approach to motion perception" 79-87, 1988.

23 "A Computational Framework and an Algorithm for the Measurement of Visual Motion Int. Journal of Computer Vision" 283-310, 1989.