Optical Flow Estimation
This project aims to estimate optical flow map between two frames.
Input Frames |
Warped Frames |
flow Map |
An pdf for optical flow introduction,including some classic methods: optical.pdf
A classic optical algorithm: Black-1993-FRE.pdf
This is a tutorial for optical computation: http://www.ceremade.dauphine.fr/~peyre/numerical-tour/tours/multidim_5_opticalflow/
Optical flow evaluation with benchmark website [2]: http://vision.middlebury.edu/flow/
References
[1]Simon Baker, Daniel Scharstein, J. P. Lewis, Stefan Roth, Michael J. Black, Richard Szeliski. A Database and Evaluation Methodology for Optical Flow. International Journal of Computer Vision 92(1): 1-31 (2011).
[2]Black,M.J. and Anandan,P. A framework for the robust estimation of optical flow. Computer Vision,1993.Proceedings.
[3]C. Liu, W. T. Freeman, E. H. Adelson and Y. Weiss Human-assisted motion annotation. IEEE Conference on Computer Vision and Pattern Recognition (CVPR), pp. 1-8, 2008.
[4]Li Xu, Jiaya Jia, Yasuyuki Matsushita.Motion Detail Preserving Optical flow Estimation. CVPR 2010
Assignment:
[1] Read the survey paper [1], and implement the classic optical flow algorithm [2]. I strongly recommend you to implement the KLT method first.
[2] Implement the algorithm [4], and test the method results for large motion images and detail structures. It would be better to accelerate it with GPU.
[3] Read and use the code of [3]. It would be better to implement it. You may do a motion interpolation demo with your flow result.
*demo images from: http://people.csail.mit.edu/celiu/OpticalFlow/