“Motion-invariant photography” by Levin, Sand, Sang Cho, Durand and Freeman

Object motion during camera exposure often leads to noticeable blurring artifacts. Proper elimination of this blur is challenging because the blur kernel is unknown, varies over the image as a function of object velocity, and destroys high frequencies. In the case of motions along a 1D direction (e.g. horizontal) we show that these challenges can be addressed using a camera that moves during the exposure. Through the analysis of motion blur as space-time integration, we show that a parabolic integration (corresponding to constant sensor acceleration) leads to motion blur that is invariant to object velocity. Thus, a single deconvolution kernel can be used to remove blur and create sharp images of scenes with objects moving at different speeds, without requiring any segmentation and without knowledge of the object speeds. Apart from motion invariance, we prove that the derived parabolic motion preserves image frequency content nearly optimally. That is, while static objects are degraded relative to their image from a static camera, a reliable reconstruction of all moving objects within a given velocities range is made possible. We have built a prototype camera and present successful deblurring results over a wide variety of human motions.

1. Bar, L., Berkels, B., Sapiro, G., and Rumpf:, M. 2007. A variational framework for simultaneous motion estimation and restoration of motion-blurred video. In ICCV.Google Scholar
2. Bascle, B., Blake, A., and Zisserman, A. 1996. Motion deblurring and superresolution from an image sequence. In ECCV. Google ScholarDigital Library
3. Ben-Ezra, M., and Nayar, S. K. 2004. Motion-based motion deblurring. PAMI. Google ScholarDigital Library
4. Canon. 2003. EF Lens Work III, The Eyes of EOS. Canon Inc. Lens Product Group.Google Scholar
5. Cathey, W., and Dowski, R. 1995. A new paradigm for imaging systems. Applied Optics 41, 1859–1866.Google Scholar
6. Chai, J.-X., Tong, X., Chan, S.-C., and Shum, H.-Y. 2000. Plenoptic sampling. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 307–318. Google ScholarDigital Library
7. Fergus, R., Singh, B., Hertzmann, A., Roweis, S. T., and Freeman, W. T. 2006. Removing camera shake from a single photograph. ACM Transactions on Graphics 25, 3 (July), 787–794. Google ScholarDigital Library
8. Horn, B. K. 1986. Robot Vision. McGraw-Hill Higher Education. Google ScholarDigital Library
9. Isaksen, A., McMillan, L., and Gortler, S. J. 2000. Dynamically reparameterized light fields. In Proceedings of ACM SIGGRAPH 2000, Computer Graphics Proceedings, Annual Conference Series, 297–306. Google ScholarDigital Library
10. Levin, A., Fergus, R., Durand, F., and Freeman, W. T. 2007. Image and depth from a conventional camera with a coded aperture. ACM Transactions on Graphics 26, 3 (July), 70:1–70:9. Google ScholarDigital Library
11. Levin, A. 2006. Blind motion deblurring using image statistics. In Advances in Neural Information Processing Systems (NIPS).Google Scholar
12. Lucy, L. 1974. Bayesian-based iterative method of image restoration. Journal of Astronomy.Google Scholar
13. Raskar, R., Agrawal, A., and Tumblin, J. 2006. Coded exposure photography: motion deblurring using fluttered shutter. ACM Transactions on Graphics 25, 3 (July), 795–804. Google ScholarDigital Library
14. Rav-Acha, A., and Peleg, S. 2005. Two motion-blurred images are better than one. Pattern Recognition Letters. Google ScholarDigital Library
15. Shi, M., and Zheng, J. 2005. A slit scanning depth of route panorama from stationary blur. In Proc. IEEE Conf. Comput. Vision Pattern Recog. Google ScholarDigital Library
16. Yuan, L., Sun, J., Quan, L., and Shum, H.-Y. 2007. Image deblurring with blurred/noisy image pairs. ACM Transactions on Graphics 26, 3 (July), 1:1–1:10. Google ScholarDigital Library