“Flow-based video synthesis and editing” by Bhat, Hodgins, Khosla and Seitz

This paper presents a novel algorithm for synthesizing and editing video of natural phenomena that exhibit continuous flow patterns. The algorithm analyzes the motion of textured particles in the input video along user-specified flow lines, and synthesizes seamless video of arbitrary length by enforcing temporal continuity along a second set of user-specified flow lines. The algorithm is simple to implement and use. We used this technique to edit video of water-falls, rivers, flames, and smoke.

1. DORETTO, G., CHIUSO, A., SOATTO, S., AND WU, Y. 2003. Dynamic textures. International Journal of Computer Vision 51, 2, 91–109. Google ScholarDigital Library
2. KWATRA, V., SCHÖDL, A., ESSA, I., TURK, G., AND BOBICK, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics, SIGGRAPH 2003, 22, 3, 277–286. Google ScholarDigital Library
3. SCHÖDL, A., AND ESSA, I. A. 2002. Controlled animation of video sprites. In ACM SIGGRAPH Symposium on Computer Animation, 121–128. Google ScholarDigital Library
4. SCHÖDL, A., SZELISKI, R., SALESIN, D. H., AND ESSA, I. 2000. Video textures. In Proceedings of ACM SIGGRAPH 2000, 489–498. Google ScholarDigital Library
5. TREUILLE, A., MCNAMARA, A., POPOVIĆ, Z., AND STAM, J. 2003. Keyframe control of smoke simulations. ACM Transactions on Graphics, SIGGRAPH 2003, 22, 3, 716–723. Google ScholarDigital Library
6. TRUCCO, E., AND VERRI, A. 1998. Introductory Techniques for 3-D Computer Vision. Prentice-Hall, Inc, New Jersey, ch. 7, 146–148. Google ScholarDigital Library
7. WANG, Y., AND ZHU, S.-C. 2002. A generative model for textured motion: Analysis and synthesis. In Proc. European Conference on Computer Vision (ECCV), 582–598. Google ScholarDigital Library
8. WEI, L.-Y., AND LEVOY, M. 2000. Fast texture synthesis using tree structured vector quantization. In Proceedings of ACM SIGGRAPH 2000, 479–488. Google ScholarDigital Library