“Filling time by plugging the holes” by Ramachandra, Ni and Nguyen

  • ©Vikas Ramachandra, Karl Ni, and Truong Nguyen




    Filling time by plugging the holes



    We explore a new technique for video frame rate up-conversion (FRUC). A noniterative multilayer motion estimation algorithm is investigated, based on spatio-temporal smoothness constraints. Our algorithm’s performance is at par with complicated iterative algorithms based on motion segmentation. For regions in the interpolated frame which cannot be motion compensated, we use an exemplar based video inpainting algorithm. To our knowledge, this is the first use of inpainting to fill in holes for FRUC.


    1. Altunbasak Y. and Tekalp, A. M. 1997 Closed-form connectivity-preserving solutions for motion compensation using 2-D meshes. In IEEE Transactions on Image Processing Vol.6, Iss.9, Pages:1255–1269.
    2. Kumar S., Biswas, M., Belongie, S. J. and Nguyen, T. Q. 2005. Spatio-temporal texture synthesis and image inpainting for video applications. In IEEE International Conference on Image processing Vol.2, No. 11–14, Pages: II- 85–89.
    3. Schutten R. J., Pelagotti A and De Haan, G. 1998. Layered motion estimation. In Philips Journal of Research Vol 51, No. 2. Pages:253–267.

ACM Digital Library Publication:

Overview Page: