Enhancing and Experiencing Spacetime Resolution

with Videos and Stills

Ankit Gupta, Pravin Bhat,   Mira Dontcheva,

Brian Curless,  Oliver Deussen,   Michael Cohen

 

 

Abstract

We present solutions for enhancing the spatial and/or temporal resolution of videos. Our algorithm targets the emerging consumer-level hybrid cameras that can simultaneously capture video and high-resolution stills. Our technique produces a high spacetime resolution video using the high-resolution stills for rendering and the low-resolution video to guide the reconstruction and the rendering process. Our framework integrates and extends two existing algorithms, namely a high-quality optical flow algorithm and a high-quality image-based-rendering algorithm. The framework enables a variety of applications that were previously unavailable to the amateur user, such as the ability to (1) automatically create videos with high spatiotemporal resolution, and (2) shift a high-resolution still to nearby points in time to better capture a missed event.

 

 

Demo video

 

 

 

 

 

Downloads

 

 

Citation

  • Gupta A., Bhat P., Dontcheva M., Curless B., Deussen O., Cohen M. Enhancing and Experiencing Spacetime Resolution with Videos and Stills. International Conference on Computational Photography (ICCP) 2009.
  • Bibtex

 

 

Related work

  • Using Photographs to Enhance Videos of a Static Scene - webpage.

 

 

Contact