“Perceptually-optimized content remapping for automultiscopic displays” by Masia, Wetzstein, Aliaga, Raskar and Gutierrez

3D content and display technology is now widely available. However, available displays range from large-screen cinematic projection systems to hand-held devices and from screens supporting glasses-free 3D modes to glasses-bound systems. Counterintuitively, the produced content is usually only generated for a single display configuration, making labor-intense, manual post-processing of the data necessary. Recently, several content remapping techniques for stereo content have been proposed (see e.g. [Lang et al. 2010]). We present a perceptually-driven optimization framework for automatic light field remapping, specially designed for automultiscopic displays. It takes into account both the limitations of the target display as well as those of a human observer, and poses the problem as a non-linear least squares optimization. Our model includes depth of field limitations and the contrast sensitivity function, as well as sensitivities to binocular disparity and motion parallax in the perception of depth. Additionally, the model can be adapted for more common stereo remapping.

1. Bradshaw, M. F., Hibbard, P. B., Parton, A. D., Rose, D., and Langley, K. 2006. Surface orientation, modulation frequency and the detection and perception of depth defined by binocular disparity and motion parallax. Vision Research 46 (September), 2636–2644.
2. Didyk, P., Ritschel, T., Eisemann, E., Myszkowski, K., and Seidel, H.-P. 2011. A perceptual model for disparity. ACM Trans. Graph. 30, 96:1–96:10.
3. Lang, M., Hornung, A., Wang, O., Poulakos, S., Smolic, A., and Gross, M. 2010. Nonlinear disparity mapping for stereoscopic 3d. ACM Trans. Graph. 29 (July), 75:1–75:10.
4. Mantiuk, R., Kim, K. J., Rempel, A. G., and Heidrich, W. 2011. HDR-VDP-2: A calibrated visual metric for visibility and quality predictions in all luminance conditions. ACM Trans. Graph. 30, 40:1–40:13.
5. Wetzstein, G., Lanman, D., Hirsch, M., and Raskar, R. 2012. Tensor Displays: Compressive Light Field Display using Multilayer Displays with Directional Backlighting. ACM Trans. Graph. 31, 1–11.