Direkt zum Inhalt springen
Computer Vision Group
TUM School of Computation, Information and Technology
Technical University of Munich

Technical University of Munich

Menu

Links

Informatik IX
Computer Vision Group

Boltzmannstrasse 3
85748 Garching info@vision.in.tum.de

Follow us on:

News

04.03.2024

We have twelve papers accepted to CVPR 2024. Check our publication page for more details.

18.07.2023

We have four papers accepted to ICCV 2023. Check out our publication page for more details.

02.03.2023

CVPR 2023

We have six papers accepted to CVPR 2023. Check out our publication page for more details.

15.10.2022

NeurIPS 2022

We have two papers accepted to NeurIPS 2022. Check out our publication page for more details.

15.10.2022

WACV 2023

We have two papers accepted at WACV 2023. Check out our publication page for more details.

More


Differences

This shows you the differences between two versions of the page.

Link to this comparison view

Both sides previous revision Previous revision
Next revision
Previous revision
research:image-based_3d_reconstruction [2015/05/19 23:17]
Prof. Dr. Jörg Stückler
research:image-based_3d_reconstruction [2017/05/22 13:06]
maierr
Line 1: Line 1:
 ====== Image-based 3D Reconstruction ====== ====== Image-based 3D Reconstruction ======
  
-Contact: [[members:stueckle|Jörg Stückler]]+Contact: [[members:cremers|Prof. Dr. Daniel Cremers]]
  
-\\ 
  
 For a human, it is usually an easy task to get an idea of the 3D structure shown in an image. Due to the loss of one dimension in the projection process, the estimation of the true 3D geometry is difficult and a so called ill-posed problem, because usually infinitely many different 3D surfaces may produce the same set of images. For a human, it is usually an easy task to get an idea of the 3D structure shown in an image. Due to the loss of one dimension in the projection process, the estimation of the true 3D geometry is difficult and a so called ill-posed problem, because usually infinitely many different 3D surfaces may produce the same set of images.
  
  
-<html><iframe width="425" height="349" src="//www.youtube.com/embed/omzQX7YF2s4" frameborder="0" allowfullscreen></iframe></html> +====3D Reconstruction from Multiple Views =====
-\\ +
-3D reconstruction of barley from 25 input images.+
  
-===== 3D Reconstruction from multiple views =====+The goal of [[research:image-based_3d_reconstruction:multiviewreconstruction|multiview 3D reconstruction]] is to infer geometrical structure of a scene captured by a collection of images. 
  
-The goal of multiview 3D reconstruction is to infer geometrical structure of a scene captured by a collection of images. Usually the camera position and internal  parameters are assumed to be known or they can be estimated from the set of images. 
-By using multiple images, 3D information can be (partially) recovered by solving a pixel-wise correspondence problem. Since automatic correspondence estimation is usually ambiguous and incomplete further knowledge (prior knowledge) about the object is necessary. A typical prior is assume that the object surface is smooth. 
  
-{{:research:topics:image-based_3d_reconstruction:beethoven_reconstruction.gif?nolink|}}+===== Spatio-Temporal 3D Reconstruction from Multiple Videos =====
  
-{{ :research:topics:image-based_3d_reconstruction:bunny_evolution.gif?nolink|}}+Considering a dynamic scene that changes over time, 3D reconstruction can be applied to every time step independently. However, one can achieve temporally more consistent results by using the information from several time frames together, thus computing a spatio-temporal hyper-surface in 4D space. See this [[research:image-based_3d_reconstruction:multiviewreconstruction|link]] for details.
  
-\\ 
-\\ 
  
-Our research is focused on convex variational methods. The 3D reconstruction problem is formulated as an energy minimization problem. +===== 3D Reconstruction from a Single View =====
-Due to the convexity of this energy, any (local) minimizer corresponds to the global minimum of this energy.\\+
  
-Minimizers of this energy are found with iterative numerical optimization methods which evolve the surface gradually from the initial surface to best one with respect to energy functional.\\ +The [[research:image-based_3d_reconstruction:singleviewreconstruction|estimation of 3D geometry from a single image]] is a special case of image-based 3D reconstruction from several imagesbut is considerably more difficult since depth cannot be estimated from pixel correspondencesThusfurther prior knowledge or user input is needed in order to recover or infer any depth information. 
-As a further consequence of the convexity, these methods are independent of the initialization. The initial surface can be of any shape, for example a simple box. +
- +
-\\ \\ +
-\\ \\ +
-\\ +
- +
-Two example reconstructions are shown below along with some of their corresponding input images. +
- +
-{{:research:topics:image-based_3d_reconstruction:stat_img_1.png?120&nolink|}} +
-{{:research:topics:image-based_3d_reconstruction:stat_img_2.png?120&nolink|}} +
-{{:research:topics:image-based_3d_reconstruction:stat_1.png?95&nolink|}} +
-{{:research:topics:image-based_3d_reconstruction:stat_2.png?95&nolink|}} +
-{{:research:topics:image-based_3d_reconstruction:stat_3.png?95&nolink|}} +
-{{:research:topics:image-based_3d_reconstruction:stat_4.png?95&nolink|}} +
- +
-\\ +
- +
-{{:research:topics:image-based_3d_reconstruction:bird_img.png?120&nolink|}} +
-{{:research:topics:image-based_3d_reconstruction:bird_img_2.png?120&nolink|}} +
-{{:research:topics:image-based_3d_reconstruction:bird_aniso_1.png?130&nolink|}} +
-{{:research:topics:image-based_3d_reconstruction:bird_aniso_2.png?280&nolink|}} +
- +
- +
-\\ +
-\\ +
- +
-===== Spatio-Temporal 3D Reconstruction from multiple videos ===== +
- +
-Considering a dynamic scene that changes over time3D reconstruction can be applied to every time step independentlyHoweverone can achieve temporally more consistent results by using the information from several time frames together, thus computing a spatio-temporal hyper-surface in 4D space. +
- +
-The following video shows results of our latest publication on 4D reconstruction. +
-<html><center><iframe width="640" height="480" src="//www.youtube.com/embed/axGBJbawacA" frameborder="0" allowfullscreen></iframe></center></html> +
- +
-\\ +
-\\ +
-\\ +
-====== Related publications ====== +
-<bibtex> +
-<keywords>3d-reconstruction</keywords> +
-</bibtex>+
  

Rechte Seite

Informatik IX
Computer Vision Group

Boltzmannstrasse 3
85748 Garching info@vision.in.tum.de

Follow us on:

News

04.03.2024

We have twelve papers accepted to CVPR 2024. Check our publication page for more details.

18.07.2023

We have four papers accepted to ICCV 2023. Check out our publication page for more details.

02.03.2023

CVPR 2023

We have six papers accepted to CVPR 2023. Check out our publication page for more details.

15.10.2022

NeurIPS 2022

We have two papers accepted to NeurIPS 2022. Check out our publication page for more details.

15.10.2022

WACV 2023

We have two papers accepted at WACV 2023. Check out our publication page for more details.

More