Rapid Shape Acquisition Using Color Structured Light and Multi-pass Dynamic Programming

Li Zhang, Brian Curless, and Steven M. Seitz

Abstract

This paper presents a color structured light technique for recovering object shape from one or more images. The technique works by projecting a pattern of stripes of alternating colors and matching the projected color transitions with observed edges in the image. The correspondence problem is solved using a novel, multi-pass dynamic programming algorithm that eliminates global smoothness assumptions and strict ordering constraints present in previous  formulations. The resulting approach is suitable for generating both high-speed scans of moving objects when projecting a single stripe pattern and high-resolution scans of static scenes using a short sequence of time-shifted stripe patterns. In the latter case, spacetime analysis is used at each sensor pixel to obtain inter-frame depth localization. Results are demonstrated for a variety of complex scenes.

Citation (bibtex)
Li Zhang, Brian Curless, and Steven M. Seitz. Rapid Shape Acquisition Using Color Structured Light and Multi-pass Dynamic Programming. In Proceedings of the 1st International Symposium on 3D Data Processing, Visualization, and Transmission (3DPVT), Padova, Italy, June 19-21, 2002, pp. 24-36. [paper: PDF(8.3M)]


Videos

Fist and Hand

=>

Input image

Range surface (AVI, 1.7M)
Underlying wire frame (AVI, 1.9M)

Porcelain cat

=>

Input image

Range surface (AVI,1M)

Bulging arm

=>

Input sequence (AVI 1.8M)

Range surface (AVI, 3.2M)

Grasping hand

=>

Input sequence (AVI, 5.0M)

Range surface (AVI, 3.1M)

Einstein bust

One shot method:

=>

Input image

Range surface (AVI, 783K)

Interlacing shifted one-shot:

=>

7-frame input sequene (AVI, 341K)

Range surface (AVI, 1.0M)

Zoom in the left eye

Zoom in the letter "mc"

Spacetime analysis:

=>

7-frame input sequene (AVI, 260K)

Range surface (AVI, 945K)

Zoom in the left eye

Zoom in the letter "mc"


See more recent work on Spacetime Stereo!