Reconstructing Plants in 3D from a Single Image Using Analysis-by-Synthesis [chapter]

Jérôme Guénard, Géraldine Morin, Frédéric Boudon, Vincent Charvillat
2013 Lecture Notes in Computer Science  
Mature computer vision techniques allow the reconstruction of challenging 3D objects from images. However, due to high complexity of plant topology, dedicated methods for generating 3D plant models must be devised. We propose to generate a 3D model of a plant, using an analysis-by-synthesis method mixing information from a single image and a priori knowledge of the plant species. First, our dedicated skeletonisation algorithm generates a possible branching structure from the foliage
more » ... . Then, a 3D generative model, based on a parametric model of branching systems that takes into account botanical knowledge is built. The resulting skeleton follows the hierarchical organisation of natural branching structures. An instance of a 3D model can be generated. Moreover, varying parameter values of the generative model (main branching structure of the plant and foliage), we produce a series of candidate models. The reconstruction is improved by selecting the model among these proposals based on a matching criterion with the image. Realistic results obtained on different species of plants illustrate the performance of the proposed method. Fig. 1. On the left, an original image of Ginkgo tree. In the middle, a possible architecture of the branching extracted with our skeletonisation method. On the right, a 3D model of this tree with the same viewpoint.
doi:10.1007/978-3-642-41914-0_32 fatcat:336egggpmfftrfgp4gji3jz3xi