Interactive Surface Reconstruction from Incomplete Point Clouds with Curve-Driven Topology and Geometry Control

ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia 2014)

Kangxue Yin1     Hui Huang1∗     Hao Zhang2     Minglun Gong3     Daniel Cohen-Or4     Baoquan Chen5 

1Shenzhen VisuCA Key Lab / SIAT     2Simon Fraser University     3Memorial University of Newfoundland     4Tel-Aviv University     5Shandong University

Figure 1: A sparse and incomplete point cloud (on the left) acquired by scanning a shiny metal artwork (in the inset) is interactively reconstructed (in the middle) by our morfit technique with sweeping red profile curves (geometry control) along its green skeleton (topology control). 


With significant data missing in a point scan, reconstructing a complete surface with sufficient geometric and topological fidelity is highly challenging. We present an interactive technique for surface reconstruction from incomplete and sparse scans of 3D objects possessing sharp features. A fundamental premise of our interaction paradigm is that directly editing data in 3D is not only counterintuitive but also ineffective, while working with 1D entities (i.e., curves) is a lot more manageable. To this end, we factor 3D editing into two “orthogonal” interactions acting on skeletal and profile curves of the underlying shape, controlling its topology and geometric features, respectively. For surface completion, we introduce a novel skeleton-driven morph-to-fit, or morfit, scheme which reconstructs the shape as an ensemble of generalized cylinders. Morfit is a hybrid operator which optimally interpolates between adjacent curve profiles (the “morph”) and snaps the surface to input points (the “fit”). The interactive reconstruction iterates between user edits and morfit to converge to a desired final surface. We demonstrate various interactive reconstructions from point scans with sharp features and significant missing data. 


Figure 2: Enhancing sharp features and merging: given the skeleton for the gecko shape (a), three branch paths (purple, blue, and green) are automatically detected, leading to the reconstruction of three generalized cylinders (b); sharp features can be enhanced by interactive scribbling, e.g., orange stroke on the surface (b), or editing a profile curve on a cross-sectional slice (c-d); merging the enhanced cylinders gives us a manifold surface (e) and smoothing is performed at the intersections between the cylinders.

Figure 3: Given an incomplete scan (a) of a metal sculpture (inset at the right), the automatically generated skeleton (b) contains some topological errors. These errors are corrected interactively, where the revised skeleton is decomposed into several branch paths shown using different colors (c). By applying morfit to each branch path and then performing cylinder merging, the sculpture shape is well reconstructed (d). With more user effort, e.g., indicating where to enhance sharp features, shown as orange lines in (d), and subsequent user editing of a few profile curves, the final reconstructed surface (e) can faithfully model the original sculpture.


Figure 4: Reconstruction with texture mapping: given an incomplete scan (left) of a real object (inset), our approach can generate a photo-realistic model (right) after texture mapping that also captures sharp features (e.g., teeth) and thin structures (e.g., ears).

Figure 5: Additional morfit reconstruction results with evaluation on four complex models. The columns show the virtual models, virtual scans with significant missing data, curve skeletons (green) and profile curves (red), the final reconstructions, and error plots from left to right. Some surface details were smoothed out, e.g., comparing areas highlighted within the blue boxes, while the overall reconstruction errors (see color plots and the maximum error values in (a)-(d) captions) remain low.


The authors would like to thank all the reviewers for their valuable comments and feedback. This work is supported in part by grants from NSFC (61379090, 61202224, 61331018), National 973 Program (2014CB360503), National 863 Program (2013AA01A604), Shenzhen Innovation Program (CXB201104220029A, KQCX20120807104901791, ZD201111080115A, JSGG20130624154940238), SIAT Innovation Program for Excellent Young Researchers (201305), NSERC (611370 and 293127) and the Israel Science Foundation. 


@ ARTICLE {yin_siga14,

    author = {Kangxue Yin and Hui Huang and Hao Zhang and Minglun Gong and Daniel Cohen-Or and Baoquan Chen},

    title = {Morfit: Interactive Surface Reconstruction from Incomplete Point Clouds with Curve-Driven Topology and Geometry Control},

    journal = {ACM Transactions on Graphics (Special Issue of SIGGRAPH Asia)},

    volume = {33},

    number = {6},

    pages = {Article 202},

    year = {2014}


Copyright © 2016-2018 Visual Computing Research Center