Differences
This shows you the differences between two versions of the page.
Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
research:image-based_3d_reconstruction [2014/02/23 14:00] oswaldm |
research:image-based_3d_reconstruction [2015/05/20 00:47] Prof. Dr. Jörg Stückler |
||
---|---|---|---|
Line 1: | Line 1: | ||
====== Image-based 3D Reconstruction ====== | ====== Image-based 3D Reconstruction ====== | ||
- | Contact: [[members:oswaldm|Martin Oswald]], [[members:klodt|Maria Klodt]] | + | Contact: [[members:stueckle|Jörg Stückler]], [[members:cremers|Prof. Dr. Daniel Cremers]] |
- | \\ | ||
For a human, it is usually an easy task to get an idea of the 3D structure shown in an image. Due to the loss of one dimension in the projection process, the estimation of the true 3D geometry is difficult and a so called ill-posed problem, because usually infinitely many different 3D surfaces may produce the same set of images. | For a human, it is usually an easy task to get an idea of the 3D structure shown in an image. Due to the loss of one dimension in the projection process, the estimation of the true 3D geometry is difficult and a so called ill-posed problem, because usually infinitely many different 3D surfaces may produce the same set of images. | ||
- | < | + | ===== 3D Reconstruction |
- | \\ | + | |
- | 3D reconstruction of barley | + | |
- | ===== 3D Reconstruction from multiple views ===== | + | The goal of [[research: |
- | The goal of multiview 3D reconstruction is to infer geometrical structure of a scene captured by a collection of images. Usually the camera position and internal | ||
- | By using multiple images, 3D information can be (partially) recovered by solving a pixel-wise correspondence problem. Since automatic correspondence estimation is usually ambiguous and incomplete further knowledge (prior knowledge) about the object is necessary. A typical prior is assume that the object surface is smooth. | ||
- | {{: | + | ===== Spatio-Temporal 3D Reconstruction from Multiple Videos ===== |
- | {{ :research:topics: | + | Considering a dynamic scene that changes over time, 3D reconstruction can be applied to every time step independently. However, one can achieve temporally more consistent results by using the information from several time frames together, thus computing a spatio-temporal hyper-surface in 4D space. See this [[research: |
- | \\ | ||
- | \\ | ||
- | Our research is focused on convex variational methods. The 3D reconstruction problem is formulated as an energy minimization problem. | + | ===== 3D Reconstruction from a Single View ===== |
- | Due to the convexity of this energy, any (local) minimizer corresponds to the global minimum of this energy.\\ | + | |
- | Minimizers of this energy are found with iterative numerical optimization methods which evolve the surface gradually from the initial surface to best one with respect to energy functional.\\ | + | The [[research: |
- | As a further consequence of the convexity, these methods are independent of the initialization. | + | |
- | + | ||
- | \\ \\ | + | |
- | \\ \\ | + | |
- | \\ | + | |
- | + | ||
- | Two example reconstructions are shown below along with some of their corresponding input images. | + | |
- | + | ||
- | {{:research:topics: | + | |
- | {{: | + | |
- | {{: | + | |
- | {{: | + | |
- | {{: | + | |
- | {{: | + | |
- | + | ||
- | \\ | + | |
- | + | ||
- | {{: | + | |
- | {{: | + | |
- | {{: | + | |
- | {{: | + | |
- | + | ||
- | + | ||
- | \\ | + | |
- | \\ | + | |
- | + | ||
- | ===== Spatio-Temporal | + | |
- | + | ||
- | Considering a dynamic scene that changes over time, 3D reconstruction can be applied to every time step independently. However, one can achieve temporally more consistent results by using the information | + | |
- | + | ||
- | The following video shows results of our latest publication on 4D reconstruction. | + | |
- | < | + | |
- | + | ||
- | \\ | + | |
- | \\ | + | |
- | \\ | + | |
- | ====== Related publications ====== | + | |
- | < | + | |
- | < | + | |
- | </ | + | |