Capturing Indoor Scenes with Smartphones

UIST 2012

Aditya Sankar - University of Washington
Steve Seitz  - University of Washington & Google


Abstract -- In this paper, we present a novel smartphone application designed to easily capture, visualize and reconstruct homes, offices and other indoor scenes. Our application leverages data from smartphone sensors such as the camera, accelerometer, gyroscope and magnetometer to help model the indoor scene. The output of the system is two-fold; first, an interactive visual tour of the scene is generated in real time that allows the user to explore each room and transition between connected rooms. Second, with some basic interactive photogrammetric modeling the system generates a 2D floor plan and accompanying 3D model of the scene, under a Manhattan-world assumption. The approach does not require any specialized equipment or training and is able to produce accurate floor plans.

Our system captures an interactive visual tour and a floor plan of an indoor scene, in real time, on a smartphone.

Paper: PDF (11 MB)

Citation: Aditya Sankar and Steven Seitz. 2013. "Capturing indoor scenes with smartphones."
In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). (ACM DL) (BibTeX)

Acknowledgements: This work was supported in part by NSF grants IIS-0811878 and IIS-0963657, SPAWAR, the University of Washington Animation Research Labs, and Google.

Contact Author: Aditya Sankar, aditya[at]cs[dot]washington[dot]edu