Optical Flow Estimation

This project aims to estimate optical flow map between two frames.

Input Frames

Input Frames

Warped Frames

Warped Frames

flow Map

Disparity Map

 

An pdf for optical flow introduction,including some classic methods: optical.pdf

A classic optical algorithm: Black-1993-FRE.pdf

This is a tutorial for optical computation: http://www.ceremade.dauphine.fr/~peyre/numerical-tour/tours/multidim_5_opticalflow/

Optical flow evaluation with benchmark website [2]: http://vision.middlebury.edu/flow/

References

[1]Simon Baker, Daniel Scharstein, J. P. Lewis, Stefan Roth, Michael J. Black, Richard Szeliski. A Database and Evaluation Methodology for Optical Flow. International Journal of Computer Vision 92(1): 1-31 (2011).

[2]Black,M.J. and Anandan,P. A framework for the robust estimation of optical flow. Computer Vision,1993.Proceedings.

[3]C. Liu, W. T. Freeman, E. H. Adelson and Y. Weiss Human-assisted motion annotation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-8, 2008.

[4]Li Xu, Jiaya Jia, Yasuyuki Matsushita.Motion Detail Preserving Optical flow Estimation. CVPR 2010

Assignment:

[1] Read the survey paper [1], and implement the classic optical flow algorithm [2]. I strongly recommend you to implement the KLT method first.

[2] Implement the algorithm [4], and test the method results for large motion images and detail structures. It would be better to accelerate it with GPU.

[3] Read and use the code of [3]. It would be better to implement it. You may do a motion interpolation demo with your flow result.

*demo images from: http://people.csail.mit.edu/celiu/OpticalFlow/