Silhouettes Preserved 3D Object Reconstruction from Multi-View Images

Abstract

In this paper, we propose a novel method to recover a 3D object surface with silhouette preserved and high photo consistency properties from multi-view images. Our method is composed of two phases. In the first phase, ”Silhouettes Preserved Volumetric Graph Cuts”, a modified volumetric graph cuts algorithm, is used. This algorithm is based on the traditional volumetric graph cuts. However it adjusts the parameters according to the output of volumetric graph cuts and improves the result in an iterative way. These iterative steps will not stop until the obtained 3D surface perfectly matches the observed pictures’ silhouettes. Then, the 3d surface will be refined by Gradient Descent in the second phase. In this phase, the positions of the vertices on the surface will be updated along the normal directions to make the surface’s photo consistency optimized. In the experiment, we test our method with two synthesis models and one real object, and the improvement is obvious, especially in a complicated model case.