“Metric-aware processing of spherical imagery”
Conference:
Type(s):
Title:
- Metric-aware processing of spherical imagery
Session/Category Title: Image & video editing
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Processing spherical images is challenging. Because no spherical parameterization is globally uniform, an accurate solver must account for the spatially varying metric. We present the first efficient metric-aware solver for Laplacian processing of spherical data. Our approach builds on the commonly used equirectangular parameterization, which provides differentiability, axial symmetry, and grid sampling. Crucially, axial symmetry lets us discretize the Laplacian operator just once per grid row. One difficulty is that anisotropy near the poles leads to a poorly conditioned system. Our solution is to construct an adapted hierarchy of finite elements, adjusted at the poles to maintain derivative continuity, and selectively coarsened to bound element anisotropy. The resulting elements are nested both within and across resolution levels. A streaming multigrid solver over this hierarchy achieves excellent convergence rate and scales to huge images. We demonstrate applications in reaction-diffusion texture synthesis and panorama stitching and sharpening.
References:
1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Trans. on Graphics 23, 3, 294–302. Google ScholarDigital Library
2. Agrawal, A., and Raskar, R. 2007. Gradient domain manipulation techniques in vision and graphics. In ICCV 2007 Course.Google Scholar
3. Bhat, P., Curless, B., Cohen, M., and Zitnick, L. 2008. Fourier analysis of the 2D screened Poisson equation for gradient domain problems. In European Conference on Computer Vision, 114–128. Google ScholarDigital Library
4. Briggs, W., Henson, V., and McCormick, S. 2000. A Multi-grid Tutorial. Society for Industrial and Applied Mathematics. Google ScholarDigital Library
5. Cephes, 1995. http://www.netlib.org/cephes/.Google Scholar
6. Fekete, G. 1990. Rendering and managing spherical data with sphere quadtrees. In Proceedings of Visualization ’90, 176–186. Google ScholarDigital Library
7. Fu, W., Wan, L., Wong, T., and Leung, C. 2009. The rhombic dodecahedron map: An efficient scheme for encoding panoramic video. IEEE Trans. on Multimedia 11, 4, 634–644. Google ScholarDigital Library
8. Górski, K., Hivon, E., Banday, A., Wandelt, B., Hansen, F., Reinecke, M., and Bartelmann, M. 2005. HEALPix: A framework for high-resolution discretization and fast analysis of data distributed on the sphere. The Astrophysical Journal 622, 759–771.Google ScholarCross Ref
9. Grinspun, E., Krysl, P., and Schröder, P. 2002. CHARMS: A simple framework for adaptive simulation. Trans. on Graphics 21, 3, 281–290. Google ScholarDigital Library
10. Karčiauskas, K., and Peters, J. 2006. A C
2 polar jet subdivision. In Symposium on Geometry Processing, 173–180. Google ScholarDigital Library
11. Kazhdan, M., and Hoppe, H. 2008. Streaming multigrid for gradient-domain operations on large images. ACM Trans. on Graphics 27, 3. Google ScholarDigital Library
12. Kazhdan, M., Surendran, D., and Hoppe, H. 2010. Distributed gradient-domain processing of planar and spherical images. ACM Trans. on Graphics 29, 2. Google ScholarDigital Library
13. Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Trans. on Graphics 25, 3. Google ScholarDigital Library
14. Levin, A., Zomet, A., Peleg, S., and Weiss, Y. 2004. Seamless image stitching in the gradient domain. In European Conference on Computer Vision, 377–389.Google Scholar
15. Miller, G., and Hoffman, R. 1984. Illumination and reflection maps: Simulated objects in simulated and real environments. In SIGGRAPH 84: Advanced Computer Graphics Animation Seminar Notes.Google Scholar
16. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Trans. on Graphics 22, 3, 313–318. Google ScholarDigital Library
17. Schaffer, S. 1998. A semicoarsening multigrid method for elliptic partial differential equations with highly discontinuous and anisotropic coefficients. SIAM J. Sci. Comput. 20, 1, 228–242. Google ScholarDigital Library
18. Schröder, P., and Sweldens, W. 1995. Spherical wavelets: Efficiently representing functions on the sphere. In ACM SIGGRAPH Conference Proceedings, 161–172. Google ScholarDigital Library
19. Schröder, P., and Sweldens, W. 1995. Spherical wavelets: Texture processing. In Proceedings of Rendering Techniques.Google Scholar
20. Stam, J. 2003. Flows on surfaces of arbitrary topology. ACM Trans. on Graphics 22, 3, 724–731. Google ScholarDigital Library
21. Stüben, K. 2001. A review of algebraic multigrid. Journal of Computational and Applied Mathematics 128, 1–2. Google ScholarDigital Library
22. Turing, A. 1952. The chemical basis of morphogenesis. Philosophical Trans. of the Royal Society of London 237, 37–72.Google ScholarCross Ref
23. Turk, G. 1991. Generating textures on arbitrary surfaces using reaction-diffusion. In ACM SIGGRAPH Conference Proceedings, 289–298. Google ScholarDigital Library
24. Wan, L., Wong, T., and Leung, C. 2007. Isocube: Exploiting the cubemap hardware. IEEE Trans. on Visualization and Computer Graphics 13, 4, 720–731. Google ScholarDigital Library
25. Witkin, A., and Kass, M. 1991. Reaction-diffusion textures. In ACM SIGGRAPH Conference Proceedings, 299–308. Google ScholarDigital Library
26. Ying, L., Hertzmann, A., Biermann, H., and Zorin, D. 2001. Texture and shape synthesis on surfaces. In Eurographics Workshop on Rendering Techniques, 301–312. Google ScholarDigital Library
