“Joint bilateral upsampling” by Kopf, Cohen, Lischinski and Uyttendaele

Image analysis and enhancement tasks such as tone mapping, colorization, stereo depth, and photomontage, often require computing a solution (e.g., for exposure, chromaticity, disparity, labels) over the pixel grid. Computational and memory costs often require that a smaller solution be run over a downsampled image. Although general purpose upsampling methods can be used to interpolate the low resolution solution to the full resolution, these methods generally assume a smoothness prior for the interpolation.We demonstrate that in cases, such as those above, the available high resolution input image may be leveraged as a prior in the context of a joint bilateral upsampling procedure to produce a better high resolution solution. We show results for each of the applications above and compare them to traditional upsampling methods.

1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 294–302. Google ScholarDigital Library
2. Barash, D. 2002. A fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 6, 844–847. Google ScholarDigital Library
3. Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 11, 1222–1239. Google ScholarDigital Library
4. Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3 (Proc. SIGGRAPH 2002), 257–266. Google ScholarDigital Library
5. Durand, F., Holzschuch, N., Soler, C., Chan, E., and Sillion, F. X. 2005. A frequency analysis of light transport. ACM Transactions on Graphics 24, 3 (Proc. SIGGRAPH 2005), 1115–1126. Google ScholarDigital Library
6. Eisemann, E., and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 673–678. Google ScholarDigital Library
7. Elad, M. 2002. On the bilateral filter and ways to improve it. IEEE Transactions on Image Processing 11, 10, 1141–1151. Google ScholarDigital Library
8. Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics 21, 3 (Proc. SIGGRAPH 2002), 249–256. Google ScholarDigital Library
9. Flint, G. 2007. The Gigapxl Project.Google Scholar
10. Kopf, J., Uyttendaele, M., Deussen, O., and Cohen, M. F. 2007. Capturing and viewing gigapixel images. ACM Transactions on Graphics 26, 3 (Proc. SIGGRAPH 2007). Google ScholarDigital Library
11. Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 689–694. Google ScholarDigital Library
12. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 646–653. Google ScholarDigital Library
13. Paris, S., and Durand, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. Proceedings of ECCV 2006). Google ScholarDigital Library
14. Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 664–672. Google ScholarDigital Library
15. Ramanath, R., and Snyder, W. 2003. Adaptive demosaicking. Journal of Electronic Imaging 12, 4, 633–642.Google ScholarCross Ref
16. Reinhard, E., Ward, G., Pattanaik, S., and Debevec, P. 2005. High Dynamic Range Imaging. Morgan Kaufmann.Google Scholar
17. Sawhney, H. S., Guo, Y., Hanna, K., Kumar, R., Adkins, S., and Zhou, S. 2001. Hybrid stereo camera: an ibr approach for synthesis of very high resolution stereoscopic image sequences. Proceedings of SIGGRAPH 2001, 451–460. Google ScholarDigital Library
18. Scharstein, D., and Szeliski, R. 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47, 1–3, 7–42. Google ScholarDigital Library
19. Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 1135–1143. Google ScholarDigital Library
20. Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. Proceedings of ICCV 1998, 839–846. Google ScholarDigital Library
21. Weiss, B. 2006. Fast median and bilateral filtering. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 519–526. Google ScholarDigital Library
22. Wolberg, G. 1990. Digital Image Warping. IEEE Computer Society Press, Los Alamitos, CA. Google ScholarDigital Library
23. Yatziv, L., and Sapiro, G. 2006. Fast image and video colorization using chrominance blending. IEEE Transactions on Image Processing 15, 5, 1120–1129. Google ScholarDigital Library