“A real-time low-latency hardware light-field renderer” by Regan, Miller, Rubin and Kogelnik

This paper describes the design and implementation of an architecture for interactively viewing static light fields with very low latency. The system was deliberately over engineered to specifications much tighter than expected necessary to eliminate perceptible latency. This allowed us to relax the specifications to the point at which human users began to detect latency artifacts. We found empirically that when interacting with a light field, human users began to notice latency artifacts when the total system latency is approximately 15 ms. Although the architecture may not be used in practice, this result should prove fundamental for designers of future interactive graphics systems.

1. Azuma, R., Predictive Tracking for Augmented Reality. UNC Chapel Hill Department of Computer Science PhD Dissertation 1995.
2. Chen, S.E., Williams L., “View Interpolation for Synthetic Image Synthesis” Computer Graphics (SIGGRAPH ’93 Proceedings), Vol. 26, 1992, pp 279-288.
3. Cutler, L.D, Frolich, B., and Hanrahan, P., “Two- Handed Direct Manipulation on the Responsive Workbench”, 1997 Symposium on Interactive 3D Graphics, pp. 107–114, 1997.
4. Deering, M., “High resolution virtual reality”, Computer Graphics (SIGGRAPH ’92 Proceedings), Vol. 26, 1992, pp 195-202.
5. Gersho, A., and Grey, R.M., Vector Quantization and Signal Compression, Kluwer Academic Publishers, 1992.
6. Gortler, S.J., Grzeszczuk, R., Szeliski, R., and Cohen, M., “The Lumigraph”, Computer Graphics Proceedings, Annual Conference Series (SIGGRAPH 96), pp43-54.
7. Immersion Corporation’s web page. www.immerse.com
8. Levitt, H., “Transformed Up-Down Methods in Psychoacoutics”, The Journal of the Acoustical Society of America, Vo149. No. 2 (Part 2) 1971 pp467-477.
9. Levoy, M., Hanrahan, P., “Light Field Rendering”, Computer Graphics Proceedings, Annual Conference Series (SIGGRAPH 96), pp31-42.
10. McMillan, L., Bishop, G., “Head-Tracked Stereoscopic Display using Image Warping,” Stereoscopic Displays and Virtual Reality Systems II, Proc. SPIE, Vol. 2409, S.Fisher, J. Merritt, B.Bolas eds. 1995, pp21-30
11. Olano, M., Cohen, J., Mine, M., Bishop, G., “Combatting Rendering Latency” 1995 Symposium on Interactive 3D Graphics, pp. 19–24, 1995.
12. Regan, M., Pose, R., “Priority Rendering with a Virtual Reality Address Recalculation Pipeline”, Computer Graphics Proceedings, Annual Conference Series (SIGGRAPH 94), pp155-161.
13. Welch, G., Bishop, G., “SCAAT: Incremental Tracking with Incomplete Information,” Computer Graphics Proceedings, Annual Conference Series. (SIGGRAPH 97), pp333-344.
14. Woodfill, J., and Von Herzen, B., “Real-Time Stereo Vision on the PARTS Reconfigurable Computer,” Proceedings IEEE Symposium on Field-Programmable Custom Computing Machines, Napa, pp. 242-250, April 1997.