“Tour into the picture: using a spidery mesh interface to make animation from a single image” by Horry, Anjyo and Arai

A new method called TIP (Tour Into the Picture) is presented for easily making animations from one 2D picture or photograph of a scene. In TIP, animation is created from the viewpoint of a camera which can be three-dimensionally “walked or flown-through” the 2D picture or photograph. To make such animation, conventional computer vision techniques cannot be applied in the 3D modeling process for the scene, using only a single 2D image. Instead a spidery mesh is employed in our method to obtain a simple scene model from the 2D image of the scene using a graphical user interface. Animation is thus easily generated without the need of multiple 2D images. Unlike existing methods, our method is not intended to construct a precise 3D scene model. The scene model is rather simple, and not fully 3D-structured. The modeling process starts by specifying the vanishing point in the 2D image. The background in the scene model then consists of at most five rectangles, whereas hierarchical polygons are used as a model for each foreground object. Furthermore a virtual camera is moved around the 3D scene model, with the viewing angle being freely controlled. This process is easily and effectively performed using the spidery mesh interface. We have obtained a wide variety of animated scenes which demonstrate the efficiency of TIP.

1. Beier, T., and Neely, S. “Feature-Based Image Metamorphosis” Proc. SIGGRAPH ’92 (Chicago, Illinois, July 26 – 31, 1992). In Computer Graphics, 26, 2 (July 1992), pp. 35-42.
2. Chen, S. E. “Quicktime VR – An Image-based Approach to Virtual Environment Navigation” Proc. SIGGRAPH ’95 (Los Angels, California, August 6 -11, 1995). In Computer Graphics Proceedings, Annual Conference Series, 1995. ACM SIGGRAPH, pp. 29-38.
3. Chen, S. E. and Williams, L. “View Interpolation for Image Synthesis” Proc. SIGGRAPH ’93 (Anaheim, California, August 1 – 6, 1993). In Computer Graphics Proceedings, Annual Conference Series, 1993. ACM SIGGRAPH, pp. 279-288.
4. Devebec, P.E., Taylor C.A., and Malik J. “Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image- based Approach” Proc. SIGGRAPH ’96 (New Orleans, Louisiana, August 4 – 9, 1996). In Computer Graphics Proceedings, Annual Conference Series, 1996. ACM SIGGRAPH, pp. 11-20.
5. Foley, J.D., van Dam, A., Feiner, S.K., and Hughes, J.F. Computer Graphics: Principles and Practice, Addison- Wesley, Reading, Mass., 1990.
6. Levoy, M. and Hanrahan, P. “Light Field Rendering” Proc. SIGGRAPH ’96 (New Orleans, Louisiana, August 4 – 9, 1996). In Computer Graphics Proceedings, Annual Conference Series, 1996. ACM SIGGRAPH, pp. 31-42.
7. McMillan, L. and Bishop, G. “Plenoptic Modeling: An Image-based Rendering System” Proc. SIGGRAPH ’95 (Los Angels, California, August 6 -11, 1995). In Computer Graphics Proceedings, Annual Conference Series, 1995. ACM SIGGRAPH, pp. 39-46.
8. Meier, B.J. “Painterly Rendering for Animation” Proc. SIGGRAPH ’96 (New Orleans, Louisiana, August 4 – 9, 1996). In Computer Graphics Proceedings, Annual Conference Series, 1996. ACM SIGGRAPH, pp. 477-484.
9. Seitz, S. M., and Dyer, C.R. “View Morphing” Proc. SIGGRAPH ’96 (New Orleans, Louisiana, August 4 – 9, 1996). In Computer Graphics Proceedings, Annual Conference Series, 1996. ACM SIGGRAPH, pp. 21-30.