Light Field Layer Matting
Juliet Fiss1     Brian Curless1     Richard Szeliski2    
1University of Washington    2Microsoft Research


Juliet Fiss, Brian Curless, Rick Szeliski; The IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2015, pp. 623-631 CVPR 2015 [BibTex]
Abstract
In this paper, we use matting to separate foreground layers from light fields captured with a plenoptic camera. We represent the input 4D light field as a 4D background light field, plus a 2D spatially varying foreground color layer with alpha. Our method can be used to both pull a foreground matte and estimate an occluded background light field. Our method assumes that the foreground layer is thin and fronto-parallel, and is composed of a limited set of colors that are distinct from the background layer colors. Our method works well for thin, translucent, and blurred foreground occluders. Our representation can be used to render the light field from novel views, handling disocclusions while avoiding common artifacts.
Applications Video

Download Applications Video [157 MB]
Download Paper [2.7 MB]
Download CVPR Poster [12.6 MB]
Download Bibtex Citation