Optical Flow Estimation
Estimating the motion of every pixel in a sequence of images is a problem with many applications in computer vision, such as image segmentation, object classification,visual odometry, and driver assistance.
In general, optical flow describes a sparse or dense vector field, where a displacement vector is assigned to certain pixel position, that points to where that pixel can be found in another image. In the context of scene flow estimation, which is performed on images with additional depth values, every pixel is assigned a depth displacement as well.
Since much of the structural information of a 3D scene gets lost in the imaging process, so does the motion information. The estimation of the "correct" projected motion in an image sequence is therefore highly ill-posed and has to be aided by additional priors such as the regularity of the motion. Our group mainly focuses on optical flow estimation by means of variational methods, that allow a clear formulation of the assumptions incorporated into the estimation process and generally produce dense vector fields.
Contact: Caner Hazırbaş, Philip Häusser, Frank Steinbrücker
Related publications
Export as PDF, XML, TEX or BIB
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2018
Journal Articles
[] What Makes Good Synthetic Training Data for Learning Disparity and Optical Flow Estimation? , In , volume 41, 2018. (arxiv)
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2015
Conference and Workshop Papers
[] FlowNet: Learning Optical Flow with Convolutional Networks , In IEEE International Conference on Computer Vision (ICCV), 2015. ([video],[code])
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2014
Journal Articles
[] Convex Relaxation of Vectorial Problems with Coupled Regularization , In SIAM Journal on Imaging Sciences, volume 7, 2014.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2012
Journal Articles
[] The Natural Total Variation Which Arises from Geometric Measure Theory , In SIAM Journal on Imaging Sciences, volume 5, 2012.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2011
Journal Articles
[] Bootstrap Optical Flow and Uncertainty Measure , In Computer Vision and Image Understanding, volume 115, 2011.
[] Motion Field Estimation from Alternate Exposure Images , In IEEE Transactions on Pattern Analysis and Machine Intelligence, volume 33, 2011.
[] Stereoscopic Scene Flow Computation for 3D Motion Understanding , In International Journal of Computer Vision, volume 95, 2011.
Conference and Workshop Papers
[] Multi-object tracking via high accuracy optical flow and finite set statistics , In International Conference on Acoustics, Speech and Signal Processing (ICASSP), 2011.
[] Tight Convex Relaxations for Vector-Valued Labeling Problems , In IEEE International Conference on Computer Vision (ICCV), 2011.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2010
Conference and Workshop Papers
[] Interactive Motion Segmentation , In Pattern Recognition (Proc. DAGM), Springer, volume 6376, 2010.
[] Complex Motion Models for Simple Optical Flow Estimation , In Pattern Recognition (Proc. DAGM), Springer, volume 6376, 2010.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2009
Conference and Workshop Papers
[] Advanced Data Terms for Variational Optic Flow Estimation , In Proceedings Vision, Modeling and Visualization (VMV), 2009.
[] Reconstructing Optical Flow Fields by Motion Inpainting , In Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR), Springer, volume 5681, 2009.
[] Video Super Resolution using Duality Based TV-L1 Optical Flow , In Pattern Recognition (Proc. DAGM), 2009.
[] Large Displacement Optical Flow Computation without Warping , In IEEE International Conference on Computer Vision (ICCV), 2009.
[] Structure- and Motion-adaptive Regularization for High Accuracy Optic Flow , In IEEE International Conference on Computer Vision (ICCV), 2009.
[] Variational Optical Flow from Alternate Exposure Images , In Proceedings Vision, Modeling and Visualization (VMV), 2009.
PhD Thesis
[] Restoration and Prostprocessing of Optical Flows , PhD thesis, Faculty of Mathematics and Computer Science, Heidelberg University, 2009.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2008
Conference and Workshop Papers
[] An Improved Algorithm for TV-L1 Optical Flow , In Proc. of the Dagstuhl Motion Workshop, Springer, 2008.
[] Duality TV-L1 Flow with Fundamental Matrix Prior , In Image Vision and Computing, 2008.
[] Efficient Dense Scene Flow from Sparse or Dense Stereo Data , In European Conference on Computer Vision (ECCV), 2008.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2007
Conference and Workshop Papers
[] A Duality Based Algorithm for TV-L1-Optical-Flow Image Registration , In 10th International Conference on Medical Image Computing and Computer Assisted Intervention, 2007.
[] A Duality Based Approach for Realtime TV-L1 Optical Flow , In Pattern Recognition (Proc. DAGM), 2007.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2006
Book Chapters
[] A survey on variational optic flow methods for small displacements , Chapter in Mathematical Models for Registration and Applications to Medical Imaging (O. Scherzer, ed.), Springer, volume 10, 2006.
[] Adaptive structure tensors and their applications , Chapter in Visualization and Processing of Tensor Fields (J. Weickert, H. Hagen, eds.), Springer, 2006.
Preprints
[] Highly accurate optic flow computation with theoretically justified warping , In International Journal of Computer Vision, volume 67, 2006.
Conference and Workshop Papers
[] Variational motion segmentation with level sets , In European Conference on Computer Vision (ECCV) (A. Leonardis, H. Bischof, A. Pinz, eds.), Springer, volume 3951, 2006.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2005
Journal Articles
[] Motion Competition: A variational framework for piecewise parametric motion segmentation , In International Journal of Computer Vision, volume 62, 2005.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2004
Conference and Workshop Papers
[] High accuracy optical flow estimation based on a theory for warping , In European Conference on Computer Vision (ECCV) (T. Pajdla, J. Matas, eds.), Springer, volume 3024, 2004.
Received "The Longuet-Higgins Best Paper Award" 2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2003
Journal Articles
[] Statistical shape knowledge in variational motion segmentation , In Image and Vision Computing, volume 21, 2003.
Conference and Workshop Papers
[] A generative model based approach to motion segmentation , In Pattern Recognition (Proc. DAGM) (B. Michaelis, G. Krell, eds.), Springer, volume 2781, 2003.
[] Variational space-time motion segmentation , In IEEE International Conference on Computer Vision (ICCV) (B. Triggs, A. Zisserman, eds.), volume 2, 2003.
2018 | 2015 | 2014 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002
2002
Conference and Workshop Papers
[] Statistical shape knowledge in variational motion segmentation , In 1st Internat. Workshop on Generative-Model-Based Vision (A. Pece, Y. N. Wu, R. Larsen, eds.), Univ. of Copenhagen, 2002. (http://www.diku.dk/research/published/2002/02-01)
[] Nonlinear matrix diffusion for optic flow estimation , In Pattern Recognition (Proc. DAGM) (L. van Gool, ed.), Springer, volume 2449, 2002.