Fabrication-Aware Reverse Engineering for Carpentry

SGP 2021
James Noeckel1, Haisen Zhao1,2, Brian Curless1, and Adriana Schulz1
1University of Washington
2Shandong University

reverse engineering pipeline overview

Abstract

We propose a novel method to generate fabrication blueprints from images of carpentered items. While 3D reconstruction from images is a well-studied problem, typical approaches produce representations that are ill-suited for computer-aided design and fabrication applications. Our key insight is that fabrication processes define and constrain the design space for carpentered objects, and can be leveraged to develop novel reconstruction methods. Our method makes use of domain-specific constraints to recover not just valid geometry, but a semantically valid assembly of parts, using a combination of image-based and geometric optimization techniques.

We demonstrate our method on a variety of wooden objects and furniture, and show that we can automatically obtain designs that are both easy to edit and accurate recreations of the ground truth. We further illustrate how our method can be used to fabricate a physical replica of the captured object as well as a customized version, which can be produced by directly editing the reconstructed model in CAD software.

Paper

Main paper Supplemental material
Arxiv Code
To be published in Eurographics Symposium on Geometry Processing, Volume 40 (2021), Number 5.

Video

Overview (5 min)
Full SGP Talk (14 min)

Results


Acknowledgements: This work was supported by National Science Foundation grants CCF-2017927 and EEC-2035717, UW Reality Lab funding from Facebook, Google, and Futurewei. A. Schulz acknowledges the generous support of the Google Faculty Research Award.