“Polygon-assisted JPEG and MPEG compression of synthetic images” by Levoy

Recent advances in realtime image compression and decompression hardware make it possible for a high-performance graphics engine to operate as a rendering server in a networked environment. If the client is a low-end workstation or set-top box, then the rendering task can be split across the two devices. In this paper, we explore one strategy for doing this. For each frame, the server generates a high-quality rendering and a low-quality rendering, subtracts the two, and sends the difference in compressed form. The client generates a matching low quality rendering, adds the decompressed difference image, and displays the composite. Within this paradigm, there is wide latitude to choose what constitutes a high-quality versus low-quality rendering. We have experimented with textured versus untextured surfaces, fine versus coarse tessellation of curved surfaces, Phong versus Gouraud interpolated shading, and antialiased versus nonantialiased edges. In all cases, our polygon-assisted compression looks subjectively better for a fixed network bandwidth than compressing and sending the high-quality rendering. We describe a software simulation that uses JPEG and MPEG-1 compression, and we show results for a variety of scenes.

1. Agrawala, M., Beers, A.C., Chaddha, N., “Model-based Motion Estimation for Synthetic Animations.” Submitted for publication.
2. Chen, S.E., Williams, L., “View Interpolation for Image Synthesis,” Proc. SIGGRAPH ’93 (Anaheim, California, August 1-6, 1993). In Computer Graphics Proceedings, Annual Conference Series, 1993, ACM SIGGRAPH, pp. 279-288.
3. Clark, J.H., “Hierarchical Geometric Models for Visible Surface Algorithms,” CACM, Vol. 19, No. 10, October, 1976, pp. 547-554.
4. Cook, R., Carpenter, L, Catmull, E., “The REYES Image Rendering Architecture,” Computer Graphics (Proc. Siggraph), Vol. 21, No. 4, July, 1987, pp. 95-102.
5. Danskin, J., “Higher Bandwidth X,” Proc. Multimedia ’94 (San Francisco, October 15-20, 1994), ACM, pp. 89-96.
6. Deering, M., “Geometry Compression,” Proc. SIG- GRAPH ’95 (Los Angeles, California, August 7-11, 1995), In Computer Graphics Proceedings, Annual Conference Series, 1995, ACM SIGGRAPH.
7. Fowler, J.E., Yagel, R., “Lossless Compression of Volume Data,” Proc. 1994 Symposium on Volume Visualization, A. Kaufman and W. Krueger eds., ACM, pp. 43-50.
8. Gershbein, R., Schroeder, P., Hanrahan, P., “Textures and Radiosity: Controlling Emission and Reflection with Texture Maps,” Proc. SIGGRAPH ’94 (Orlando, Florida, July 24-29, 1994). In Computer Graphics Proceedings, Annual Conference Series, 1994, ACM SIG- GRAPH, pp. 51-58.
9. Guenter, B.K., Yun, H.C., Mersereau, R.M., “Motion Compensated Compression of Computer Animation Frames,” Proc. SIGGRAPH ’93 (Anaheim, California, August 1-6, 1993). In Computer Graphics Proceedings, Annual Conference Series, 1993, ACM SIGGRAPH, pp. 297-304.
10. Hanrahan, P., Lawson, J., “A Language for Shading and Lighting Calculations,” Computer Graphics (Proc. Siggraph), Vol. 24, No. 4, August, 1990, pp. 289-298.
11. Heckbert, P., Garland, M., “Multiresolution Modeling for Fast Rendering,” Proc. Graphics Intelface ’94 (May 18-20, 1994, Banff, Alberta), Canadian Information Processing Society, pp. 43-50.
12. Hoppe, H. DeRose, T., Duchamp, T., McDonald, J., Stuetzle, W., “Mesh Optimization,” Proc. SIGGRAPH ’93 (Anaheim, California, August 1-6, 1993). In Computer Graphics Proceedings, Annual Conference Series, 1993, ACM SIGGRAPH, pp. 19-26.
13. Lane, T., Independent JPEG Group Software Codec, Version 4, Internet distribution, URL ftp://ftp.uu.net/graphics/jpeg.
14. Le Gall, D., “MPEG: A Video Compression Standard for Multimedia Applications,” CACM, Vol. 34, No. 4, April, 1991, pp. 46-58.
15. Luo, J., et al., “A New Method for Block Effect Removal in Low Bit-Rate Image Compression,” Proc. ICASSP ’94, pp. V-341-344.
16. Luther, A.C., Digital Video in the PC Environment, 2nd edition, McGraw-Hill Book Company, New York, 1991.
17. Muraki, S., “Multiscale 3D Edge Representation of Volume Data by a DOG Wavelet,” Proc. 1994 Symposium on Volume Visualization, A. Kaufman and W. Krueger eds., ACM, pp. 35-42.
18. Ning, P., Hesselink, L., “Fast Volume Rendering of Compressed Data,” Proc. Visualization ’93, G. Nielson and D. Bergeron ed., IEEE, October, 1993, pp. 11-18.
19. Rowe, L.A., Gong, K., Patel, K., Wallach, D., MPEG-1 Video Software Encoder, Version 1.3, Internet distribution, URL ftp://mm-ftp.cs.berkeley.edu/pub/multimedia/mpeg.
20. Smith, B.C., “Fast Software Processing of Motion JPEG Video,” Proc. Multimedia ’94 (San Francisco, October 15-20, 1994), ACM, pp. 77-88.
21. Wallace, G., “The JPEG Still Picture Compression Standard,” CACM, Vol. 34, No. 4, April, 1991, pp. 30-44.
22. Wallach, D.S., Kunapalli, S., Cohen, M.F., “Accelerated MPEG Compression of Dynamic Polygonal Scenes,” Proc. SIGGRAPH ’94 (Orlando, Florida, July 24-29, 1994), In Computer Graphics Proceedings, Annual Conference Series, 1994, ACM SIGGRAPH, pp. 193-197.
23. Wang, S.W., Kaufman, A.E., “Volume Sampled Voxelization of Geometric Primitives,” IEEE Computer Graphics and Applications, Vol. 14, No. 5, September, 1994, pp. 26-32.
24. Westermann, R., “A Multiresolution Framework for Volume Rendering,” Proc. 1994 Symposium on Volume Visualization, A. Kaufman and W. Krueger eds., ACM, pp. 51-58.
25. Wilhelms, J., Van Gelder, A., “Multi-Dimensional Trees for Controlled Volume Rendering and Compression,” Proc. 1994 Symposium on Volume Visualization, A. Kaufman and W. Krueger eds., ACM, pp. 27-34.