“Resolution Enhancement by Vibrating Displays” by Berthouzoz and Fattal

We present a method that makes use of the retinal integration time in the human visual system for increasing the resolution of displays. Given an input image with a resolution higher than the display resolution, we compute several images that match the display’s native resolution. We then render these low-resolution images in a sequence that repeats itself on a high refresh-rate display. The period of the sequence falls below the retinal integration time and therefore the eye integrates the images temporally and perceives them as one image. In order to achieve resolution enhancement we apply small-amplitude vibrations to the display panel and synchronize them with the screen refresh cycles. We derive the perceived image model and use it to compute the low-resolution images that are optimized to enhance the apparent resolution of the perceived image. This approach achieves resolution enhancement without having to move the displayed content across the screen and hence offers a more practical solution than existing approaches. Moreover, we use our model to establish limitations on the amount of resolution enhancement achievable by such display systems. In this analysis we draw a formal connection between our display and super-resolution techniques and find that both methods share the same limitation, yet this limitation stems from different sources. Finally, we describe in detail a simple physical realization of our display system and demonstrate its ability to match most of the spectrum displayable on a screen with twice the resolution.

Agranat, A., Gumennik, A., and Ilan, H. 2010. Refractive index engineering by fast ion implantations: A generic method for constructing multi-components electro-optical circuits. Proc. SPIE, vol. 7604.Google Scholar
Allen, W. and Ulichney, R. 2005. Wobulation: Doubling the addressed resolution of projection displays. In Proceedings of SID Symposium Digest of Technical Papers. Vol. 47.Google Scholar
Baker, S. and Kanade, T. 2000. Limits on super-resolution and how to break them. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’00). IEEE Computer Society, 2372.Google Scholar
Ben-Ezra, M., Zomet, A., and Nayar, S. 2004. Jitter camera: High resolution video from a low resolution detector. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’04). Vol. 2, IEEE Computer Society. Google ScholarDigital Library
Damera-Venkata, N. 2009. Displaying sub-frames at spatially offset positions on a circle. United States Patent 7483044 B2.Google Scholar
Damera-Venkata, N. and Chang, N. 2007a. On the resolution limits of superimposed projection. In Proceedings of the International Conference on Image Processing (ICIP’07). Vol. 5, IEEE Computer Society.Google Scholar
Damera-Venkata, N. and Chang, N. 2007b. Realizing super-resolution with superimposed projection. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR’07). 1–8.Google Scholar
Damera-Venkata, N. and Chang, N. 2009. Display supersampling. ACM Trans. Graph. 28, 1, 1–19. Google ScholarDigital Library
Didyk, P., Eisemann, E., Ritschel, T., Myszkowski, K., and Seidel, H.-P. 2010a. Apparent display resolution enhancement for moving images. ACM Trans. Graph. 29, 3. Google ScholarDigital Library
Didyk, P., Eisemann, E., Ritschel, T., Myszkowski, K., and Seidel, H.-P. 2010b. Perceptually-Motivated real-time temporal upsampling of 3D content for high-refresh-rate displays. Comput. Graph. Forum 29, 2, 713–722.Google ScholarCross Ref
Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. In Proceedings of the ACM SIGGRAPH’02 Conference. ACM Press, New York, 249–256. Google ScholarDigital Library
Hardie, R. 2007. A fast image super-resolution algorithm using an adaptive Wiener filter. IEEE Trans. Image Process. 16, 12, 2953–2964. Google ScholarDigital Library
Irani, M. and Peleg, S. 1990. Super resolution from image sequences. In Proceedings of the International Conference on Pattern Recognition. Vol. 2, 115–120.Google Scholar
Jaynes, C. and Ramakrishnan, D. 2003. Super-Resolution composition in multi-projector displays. In Proceedings of the IEEE International Workshop on Projector-Camera Systems (ProCams’03).Google Scholar
Kalloniatis, M. and Luu, C. 2009. Temporal resolution. www.webvision.med.utah.edu/temporal.html.Google Scholar
Lin, Z. and Shum, H. 2001. On the fundamental limits of reconstruction-based algorithms. IEEE Trans. Pattern Anal. Mach. Intell. 26, 1, 83–97. Google ScholarDigital Library
Mäkelä, P., Rovamo, J., and Whitaker, D. 1994. Effects of luminance and external temporal noise on flicker sensitivity as a function of stimulus size at various eccentricities. Vis. Res. 34, 15, 1981–1991.Google ScholarCross Ref
McKee, S. and Taylor, D. 1984. Discrimination of time: Comparison of foveal and peripheral sensitivity. J. Optical Soc. Amer. A1, 6, 620–628.Google ScholarCross Ref
Napoli, J., Dey, S., Stutsman, S., Cossairt, O., Purtell II, T., Hill, S., and Favalora, G. 2008. Imaging artifact precompensation for spatially multiplexed 3D displays. Proc. SPIE, vol. 6803, 680304.Google Scholar
Norwich, K. 1993. Information, Sensation, and Perception. Academic Press, San Diego, CA.Google Scholar
Park, S. C., Park, M. K., and Kang, M. G. 2003. Super-Resolution image reconstruction: A technical overview. IEEE Signal Process. Mag. 20, 3, 21–36.Google ScholarCross Ref
Platt, J. 2002. Optimal filtering for patterned displays. IEEE Signal Process. Lett. 7, 7, 179–181.Google ScholarCross Ref
Saad, Y. 2003. Iterative Methods for Sparse Linear Systems 2nd Ed. Society for Industrial and Applied Mathematics, Philadelphia, PA. Google ScholarDigital Library
Templin, K., Didyk, P., Ritschel, T., Eisemann, E., Myszkowski, K., and Seidel, H.-P. 2011. Apparent resolution enhancement for animations. In Proceedings of the 27th Spring Conference on Computer Graphics. 85–92. Google ScholarDigital Library
Youla, D. 1978. Generalized image restoration by the method of alternating orthogonal projections. IEEE Trans. Circ. Syst. 25, 9, 694–702.Google ScholarCross Ref