“Techniques for handling video in virtual environments” by Carraro, Edmark and Ensor

This paper discusses ways to incorporate video displays into virtual environments. It focuses on the virtual worlds created by a distributed multi-user simulator. Still images or video streams represent spaces within these three-dimensional worlds. The paper introduces techniques to deal with avatar movement into and out of video regions. In one technique—media melding—when an object moves from one region to another, the media used to represent that object correspondingly change. In a second technique—object tracing—when an object moves from one region to another, its actions in the second region are represented by a trace object in the first region. Pyramidic panels provide a means of dealing with viewpoint changes so that two-dimensional images and video clips can successfully simulate three-dimensional spaces. The paper concludes by suggesting ways to extend our techniques and by listing possible future studies.

1. Carraro, G., Cortes, M., Edmark, J., and Ensor, J., “The Peloton Bicycling Simulator,” Proc. VRML ’98, Monterey, CA, 16-19 February, 1998.
2. Chen, S. and Williams, L., “View Interpolation for Image Synthesis,” Proc. SIGGRAPH 93, 1-6 August, 1993, Anaheim, CA, pp. 279-288.
3. Cuesta J., Cycling World. In El Faro Web Site: http://www.elfaro.com/vrml20/cycling/thegame/
4. Debevec, P., Taylor, C., and Malik, J., “Modeling and Rendering Architecture from Photographs: A hybrid geometryand image-based approach,” Proc. SIGGRAPH 96, 4-9 August, 1996, New Orleans, LA, pp. 11-20.
5. Ensor, J. and Carraro, G., “Peloton: A Distributed Simulation for the World Wide Web,” Proc. 1998 International Conf. On Web-based Modeling and Simulation, San Diego, CA, 12-14 January, 1998.
6. Feiner, S., Macintyre, B., and Seligmann, D., “Knowledge- Based Augmented Reality,” Communications of the ACM, (36, 7), June 1993, pp. 53-62.
7. 3DK: The Virtual Studio. In GMD Web Site: http://viswiz.gmd.de/DML/vst/vst.html
8. GPIR. In Rich Gossweiler Web Site: http://reality.sgi.com/rcg/vrml/gpir/playground/playground.html
9. Horry, Y., Anjyo, K., and Arai, K., “Tour Into the Picture: Using a Spidery Mesh Interface to Make Animation from a Single Image,” Proc. SIGGRAPH ,97, 3-8 August, 1997, Los Angeles,CA, pp. 225-232.
10. Katkere, A., Moessi, S., Kuramura, D., Kelly, P., and Jain, R., “Towards Video-based Immersive Environments,” Multimedia Systems, May 1997, pp. 69-85.
11. Kelly, P., Katkere, A., Kuramura, D., Moezzi, S., Chatterjee, S., and Jain, R., “An Architecture for Multiple Perspective Interactive Video,” Proc. Multimedia ’95, San Francisco, CA, 1995, pp. 201-212.
12. McMillan, L. and Bishop, G., “Plenoptic Modeling: An Image-Based Rendering System,” Proc. SIGGRAPH 95, 6-11 August, 1995, Los Angeles, CA, pp. 39-46.
13. MPEG Home Page. In http://drogo.cselt.stet.it/mpeg
14. Interspace VR Browser. In NTT Software Corp. Web Site: http://www.ntts.com Interspace
15. Oh, S., Sugano, H., Fujikawa, K., Matsuura, T., Shimojo, S., Arikawa, M., and Miyahara, H., “A Dynamic QoS Adaptation Mechanism for Networked Virtual Reality,” Proc. Fifth IFIP International Workshop on Quality of Service, New York, May 1997, pp. 397-400.
16. Virtual Reality Bike. In Tectrix Web Site: http://www.tectrix.com/ products/VRBike/VR_Bike.html
17. Thalmann, N., and Thalmann, D., “Animating Virtual Actors in Real Environments,” Multimedia Systems, May 1997, pp. 113- 125.
18. UltraCoach VR. In Ultracoach Web Site: http://www.ultracch.com
19. Virtual Reality Modeling Language (VRML) Version 2.0. In VRML Consortium Web Site: http://www.vrml.org/ Specifications/VRML2.0/
20. Waters, R. et al., Diamond Park and Spline: Social Virtual Reality with 3D Animation, Spoken Interaction, and Runtime Extendability. Presence. Vol. 6 No. 4 pp.461-481. MIT Press
21. Yamaashi, K., Kawanata, Y., Tani, M., and Matsumoto, H., “User-Centered Video: Transmitting Video Images Based on the User’s Interest,” Proc. Chi ’95.
22. Zorin, D. and Barr, A., “Correction of Geometric Perceptual Distortions in Pictures,” Proc. SIGGRAPH 95, 6-11 August, 1995, Los Angeles, CA, pp. 257-264.