Parallax Photography: Creating 3D Cinematic Effects from Stills

Ke Colin Zheng1     Alex Colburn1     Aseem Agarwala2     Maneesh Agrawala3     Brian Curless1     David Salesin1,2     Michael Cohen4    

1University of Washington     2Adobe     3University of California, Berkeley     4Microsoft Research

We present an approach to convert a small portion of a light field with extracted depth information into a cinematic effect with simulated, smooth camera motion that exhibits a sense of 3D parallax. We develop a taxonomy of the cinematic conventions of these effects, distilled from observations of documentary film footage and organized by the number of subjects of interest in the scene. We present an automatic, content-aware approach to apply these cinematic conventions to an input light field. A face detector identifies subjects of interest. We then optimize for a camera path that conforms to a cinematic convention, maximizes apparent parallax, and avoids missing information in the input. We describe a GPU-accelerated, temporally coherent rendering algorithm that allows users to create more complex camera moves interactively, while experimenting with effects such as focal length, depth of field, and selective, depth-based desaturation or brightening. We evaluate and demonstrate our approach on a wide variety of scenes and present a user study that compares our 3D cinematic effects to their 2D counterparts.

Ke Colin Zheng, Alex Colburn, Aseem Agarwala, Maneesh Agrawala, Brian Curless, David Salesin, and Michael Cohen. Parallax Photography: Creating 3D Cinematic Effects from Stills. Proceedings of Graphic Interface, 2009.

GI 2009 pre-print (611KB PDF)
UW CSE Technical Report 09-03-02 (756KB PDF)

GI 2009 Slides Deck (with videos) (115MB)

720x480 Quicktime Movie for Download (103 MB)