Shape Analysis
Over the last years, the availability of devices for the acquisition of three-dimensional data like laser-scanners, RGB-D Vision or medical imaging devices has dramatically increased. This brings about the need for efficient algorithms to analyze three-dimensional shapes.
Our research is focused on reliable and efficient methods for the automatic interpretation of non-rigid three-dimensional shapes. In particular, we have been working on novel approaches to Shape Matching and on the design of Feature Descriptors.
Matching
The goal of shape matching is to register corresponding surface regions of two given three-dimensional shapes. This means for example to identify the hands, the feet and the head of two human figures. Once two shapes are registered, one can infer morphs between them. The video shows examples of such morphs, e.g. interpolating between a samba dancer and a hip hop dancer. In each of these example sequences, a registration of the first and the last shape has been computed, all intermediate frames are obtained by linear interpolation. The colors visualize regions which have been identified with each other.
A registration of two shapes can be the building block for measuring similarity of shapes and for performing shape statistics.
Mathematically, the task is to find a mapping from the boundary surface of one shape to the other one. This typically results in a very difficult, highly non-convex optimization problem.
We are currently working on efficient algorithms for shape matching with a focus on geometric consistency guarantees and on global optimization.
Feature Descriptors
The goal of feature descriptors is to characterize each point on an object's surface regarding its relation to the entire shape. The feature vectors of four different points of a cat are shown above.
In our research we aim at feature descriptors which are robust to shape articulations while capturing as much information as possible. A very powerful mathematical tool for this task is the eigendecomposition of the Laplace–Beltrami operator.
Contact
Related publications
Export as PDF, XML, TEX or BIB
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2024
Conference and Workshop Papers
[] Finsler-Laplace-Beltrami Operators with Application to Shape Analysis , In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2024. ([project page][video])
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2023
Conference and Workshop Papers
[] SIGMA: Quantum Scale-Invariant Global Sparse Shape Matching , In International Conference on Computer Vision (ICCV), 2023. ([pdf])
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2022
Conference and Workshop Papers
[] Intrinsic Neural Fields: Learning Functions on Manifolds , In European Conference on Computer Vision (ECCV), 2022. (Code will be released soon.)
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2021
Conference and Workshop Papers
[] Isometric Multi-Shape Matching , In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2021. ([arxiv])
Oral Presentation 2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2020
Conference and Workshop Papers
[] Unsupervised Dense Shape Correspondence using Heat Kernels , In International Conference on 3D Vision (3DV), 2020. ([arxiv])
[] Simulated Annealing for 3D Shape Correspondence , In International Conference on 3D Vision (3DV), 2020.
Oral Presentation [] Hamiltonian Dynamics for Real-World Shape Interpolation , In European Conference on Computer Vision (ECCV), 2020. ([arXiv] [code])
Spotlight Presentation [] DirectShape: Photometric Alignment of Shape Priors for Visual Vehicle Pose and Shape Estimation , In Proc. of the IEEE International Conference on Robotics and Automation (ICRA), 2020. ([video][presentation][project page][supplementary][arxiv])
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2017
Conference and Workshop Papers
[] Efficient Deformable Shape Correspondence via Kernel Matching , In International Conference on 3D Vision (3DV), 2017. ([arxiv],[Code])
Oral Presentation 2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2016
Conference and Workshop Papers
[] SHREC’16: Partial Matching of Deformable Shapes , In Proc. of Eurographics Workshop on 3D Object Retrieval (3DOR), 2016. (to appear)
[] SHREC’16: Matching of Deformable Shapes with Topological Noise , In Proc. of Eurographics Workshop on 3D Object Retrieval (3DOR), 2016. ([Dataset])
[] Efficient Globally Optimal 2D-to-3D Deformable Shape Matching , In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016. ([Code], [Homepage])
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2015
Journal Articles
[] Fast and Accurate Surface Alignment through an Isometry-Enforcing Game , In Pattern Recognition, Elsevier, volume 48, 2015.
Conference and Workshop Papers
[] A Fast Projection Method for Connectivity Constraints in Image Segmentation , In Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR) (X.-C. Tai, E. Bae, T. F. Chan, M. Lysaker, eds.), 2015.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2013
Journal Articles
[] A Scale Independent Selection Process for 3D Object Recognition in Cluttered Scenes , In International Journal of Computer Vision, Springer US, volume 102, 2013.
Conference and Workshop Papers
[] Tree Shape Priors with Connectivity Constraints using Convex Relaxation on General Graphs , In IEEE International Conference on Computer Vision (ICCV), 2013.
Oral Presentation 2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2012
Conference and Workshop Papers
[] A game-theoretic approach to deformable shape matching , In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2012.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2011
Book Chapters
[] Image Segmentation with Shape Priors: Explicit Versus Implicit Representations , Chapter in Handbook of Mathematical Methods in Imaging, Springer, 2011.
Conference and Workshop Papers
[] The Wave Kernel Signature: A Quantum Mechanical Approach To Shape Analysis , In IEEE International Conference on Computer Vision (ICCV) - Workshop on Dynamic Shape Capture and Analysis (4DMOD), 2011.
[] Sampling Relevant Points for Surface Registration , In International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 2011.
[] A Non-Cooperative Game for 3D Object Recognition in Cluttered Scenes , In International Conference on 3D Imaging, Modeling, Processing, Visualization and Transmission (3DIMPVT), 2011.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2010
Conference and Workshop Papers
[] A Game-Theoretic Approach to Fine Surface Registration without Initial Motion Estimation , In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2010.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2009
Journal Articles
[] Combined region- and motion-based 3D tracking of rigid and articulated objects , In IEEE Transactions on Pattern Analysis and Machine Intelligence, volume 32, 2009.
Conference and Workshop Papers
[] Efficient Planar Graph Cuts with Applications in Computer Vision , In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2009. (Note: This version of the paper is modified with respect to the published one: In the published version we had only cited the PhD thesis [2], as the conference paper [3] does not mention Step 13 of Algorithm 2 that restores the important property of T being a rooted tree.)
Received a CVPR Doctoral Spotlight Award [] A Closed-Form Solution for Image Sequence Segmentation with Dynamical Shape Priors , In Pattern Recognition (Proc. DAGM), 2009.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2008
Journal Articles
[] Nonlinear Dynamical Shape Priors for Level Set Segmentation , In Journal of Scientific Computing, volume 35, 2008.
Conference and Workshop Papers
[] On Errors-In-Variables Regression with Arbitrary Covariance and its Application to Optical Flow Estimation , In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008.
[] Shape Priors in Variational Image Segmentation: Convexity, Lipschitz Continuity and Globally Optimal Solutions , In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2008.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2007
Book Chapters
[] Efficient kernel density estimation of shape and intensity priors for level set segmentation , Chapter in Parametric and Geometric Deformable Models: An application in Biomaterials and Medical Imagery (J. S. Suri, A. Farag, eds.), Springer, 2007.
Journal Articles
[] A review of statistical approaches to level set segmentation: integrating color, texture, motion and shape , In International Journal of Computer Vision, volume 72, 2007.
Conference and Workshop Papers
[] Nonlinear Dynamical Shape Priors for Level Set Segmentation , In IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2007.
[] Efficient Shape Matching via Graph Cuts , In Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR), Springer, volume 4679, 2007.
[] Intrinsic Mean for Semimetrical Shape Retrieval via Graph Cuts , In Pattern Recognition (Proc. DAGM), Springer, volume 4713, 2007.
[] Fast Matching of Planar Shapes in Sub-cubic Runtime , In IEEE International Conference on Computer Vision (ICCV), 2007.
[] Globally Optimal Image Segmentation with an Elastic Shape Prior , In IEEE International Conference on Computer Vision (ICCV), 2007.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2006
Journal Articles
[] Integral invariants for shape matching , In IEEE Transactions on Pattern Analysis and Machine Intelligence, volume 28, 2006.
[] Dynamical statistical shape priors for level set based tracking , In IEEE Transactions on Pattern Analysis and Machine Intelligence, volume 28, 2006.
Conference and Workshop Papers
[] 4D shape priors for level set segmentation of the left myocardium in SPECT sequences , In Medical Image Computing and Computer Assisted Intervention (MICCAI), volume 4190, 2006.
[] Statistical priors for combinatorial optimization: efficient solutions via Graph Cuts , In European Conference on Computer Vision (ECCV) (A. Leonardis, H. Bischof, A. Pinz, eds.), Springer, volume 3953, 2006.
[] Shape Matching by Variational Computation of Geodesics on a Manifold , In Pattern Recognition (Proc. DAGM), Springer, volume 4174, 2006.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2005
Conference and Workshop Papers
[] Efficient kernel density estimation of shape and intensity priors for level set segmentation , In Medical Image Computing and Computer Assisted Intervention (MICCAI), volume 1, 2005.
[] One-shot integral invariant shape priors for variational segmentation , In Energy Minimization Methods in Computer Vision and Pattern Recognition (EMMCVPR) (A. Rangarajan, B. Vemuri, A. L. Yuille, eds.), volume 3757, 2005.
[] Dynamical statistical shape priors for level set based tracking , In Intl. Workshop on Variational and Level Set Methods (N. Paragios, F. Faugeras, T. Chan, C. Schnörr, eds.), Springer, volume 3752, 2005. (210–221)
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2004
Conference and Workshop Papers
[] Multiphase dynamic labeling for variational recognition-driven image segmentation , In European Conference on Computer Vision (ECCV) (T. Pajdla, V. Hlavac, eds.), Springer, volume 3024, 2004.
[] Kernel density estimation and intrinsic alignment for knowledge-driven segmentation: Teaching level sets to walk , In Pattern Recognition (Proc. DAGM) (C. E. Rasmussen, ed.), Springer, volume 3175, 2004.
[] High accuracy optical flow estimation based on a theory for warping , In European Conference on Computer Vision (ECCV) (T. Pajdla, J. Matas, eds.), Springer, volume 3024, 2004.
Received "The Longuet-Higgins Best Paper Award" 2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2003
Journal Articles
[] Shape Statistics in Kernel Space for Variational Image Segmentation , In Pattern Recognition, volume 36, 2003.
Awarded Best Paper of the Year 2003
Conference and Workshop Papers
[] Towards Recognition-based Variational Segmentation Using Shape Priors and Dynamic Labeling , In Scale-Space Methods in Computer Vision (L. D. Griffin, M. Lillholm, eds.), Springer, volume 2695, 2003.
[] A pseudo-distance for shape priors in level set segmentation , In IEEE 2nd Int. Workshop on Variational, Geometric and Level Set Methods (N. Paragios, ed.), 2003.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2002
Journal Articles
[] Diffusion Snakes: Introducing statistical shape knowledge into the Mumford–Shah functional , In International Journal of Computer Vision, volume 50, 2002.
Conference and Workshop Papers
[] Nonlinear shape statistics in Mumford–Shah based segmentation , In European Conference on Computer Vision (ECCV) (A. Heyden, others, eds.), Springer, volume 2351, 2002.
2024 | 2023 | 2022 | 2021 | 2020 | 2017 | 2016 | 2015 | 2013 | 2012 | 2011 | 2010 | 2009 | 2008 | 2007 | 2006 | 2005 | 2004 | 2003 | 2002 | 2000
2000
Conference and Workshop Papers
[] Diffusion Snakes using statistical shape knowledge , In Algebraic Frames for the Perception-Action Cycle (G. Sommer, Y.Y. Zeevi, eds.), Springer, volume 1888, 2000.
[] Learning of translation invariant shape knowledge for steering diffusion snakes , In Dynamische Perzeption (G. Baratoff, H. Neumann, eds.), Infix, volume 9, 2000.