“Interactive normal reconstruction from a single image”
Conference:
Type(s):
Title:
- Interactive normal reconstruction from a single image
Session/Category Title: Fun with single images
Presenter(s)/Author(s):
Abstract:
We present an interactive system for reconstructing surface normals from a single image. Our approach has two complementary contributions. First, we introduce a novel shape-from-shading algorithm (SfS) that produces faithful normal reconstruction for local image region (high-frequency component), but it fails to faithfully recover the overall global structure (low-frequency component). Our second contribution consists of an approach that corrects low-frequency error using a simple markup procedure. This approach, aptly called rotation palette, allows the user to specify large scale corrections of surface normals by drawing simple stroke correspondences between the normal map and a sphere image which represents rotation directions. Combining these two approaches, we can produce high-quality surfaces quickly from single images.
References:
1. Agrawal, A., Raskar, R., and Chellappa, R. 2006. What is the range of surface reconstructions from a gradient field? In ECCV06. http://www.umiacs.umd.edu/-aagrawal/eccv06/RangeofSurfaceReconstructions.html. Google Scholar
2. Belhumeur, P. N., Kriegman, D. J., and Yuille, A. L. 1999. The bas-relief ambiguity. Int. J. Comput. Vision 35, 1, 33–44. Google ScholarCross Ref
3. Criminisi, A., Reid, I., and Zisserman, A. 2000. Single view metrology. IJCV 40, 2 (November), 123–148. Google ScholarCross Ref
4. Fang, H., and Hart, J. C. 2004. Textureshop: texture synthesis as a photograph editing tool. In SIGGRAPH ’04, 354–359. Google Scholar
5. Frankot, R., and Chellappa, R. 1988. A method for enforcing integrability in shape from shading algorithms. PAMI 10, 4 (July), 439–451. Google ScholarDigital Library
6. Gingold, Y., and Zorin, D. 2008. Shading-based surface editing. ACM Transactions on Graphics (TOG) 27, 3. Google ScholarDigital Library
7. Gray, A. 1997. Osculating circles to plane curves. In Modern Differential Geometry of Curves and Surfaces with Mathematica, 2nd ed., Boca Raton, FL: CRC Press, 111–115.Google Scholar
8. Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577–584. Google ScholarDigital Library
9. Horn, B., and Brooks, M. 1989. Shape from Shading. The MIT Press. Google Scholar
10. Horry, Y., Anjyo, K.-I., and Arai, K. 1997. Tour into the picture: using a spidery mesh interface to make animation from a single image. In SIGGRAPH ’97, 225–232. Google Scholar
11. Karpenko, O. A., and Hughes, J. F. 2006. Smoothsketch: 3d free-form shapes from complex sketches. ACM Trans. Graph. 25, 3. Google ScholarDigital Library
12. Khan, E. A., Reinhard, E., Fleming, R. W., and Bülthoff, H. H. 2006. Image-based material editing. In SIGGRAPH ’06, 654–663. Google Scholar
13. Koenderink, J. 1998. Pictorial relief. Royal 356, 1740, 1071–1086.Google Scholar
14. Kovesi, P. 2005. Shapelets correlated with surface normals produce surfaces. In ICCV05, 994–1001. Google Scholar
15. Potetz, B. 2007. Efficient belief propagation for vision using linear constraint nodes. In CVPR 2007: Proceedings of the 2007 IEEE Computer Society Conference on Computer Vision and Pattern Recognition. IEEE Computer Society, Minneapolis, MN, USA.Google Scholar
16. Prados, E., and Faugeras, O. 2005. Shape from shading: A well-posed problem? In CVPR05, II: 870–877. Google Scholar
17. Prasad, M., Zisserman, A., and Fitzgibbon, A. 2006. Single view reconstruction of curved surfaces. In CVPR06, II: 1345–1354. Google Scholar
18. Sorkine, O., Lipman, Y., Cohen-Or, D., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In Proceedings of the Eurographics/ACM SIGGRAPH Symposium on Geometry Processing, Eurographics Association, 179–188. Google Scholar
19. Wu, T.-P., Tang, C.-K., Brown, M. S., and Shum, H.-Y. 2007. Shapepalettes: interactive normal transfer via sketching. In SIGGRAPH ’07, 44. Google Scholar
20. Yu, Y., Zhou, K., Xu, D., Shi, X., Bao, H., Guo, B., and Shum, H.-Y. 2004. Mesh editing with poisson-based gradient field manipulation. ACM Trans. Graph. 23, 3, 644–651. Google ScholarDigital Library
21. Zeng, G., Matsushita, Y., Quan, L., and Shum, H. 2005. Interactive shape from shading. In CVPR05, I: 343–350. Google Scholar
22. Zhang, R., Tsai, P.-S., Cryer, J. E., and Shah, M. 1999. Shape from shading: A survey. IEEE Transactions on Pattern Analysis and Machine Intelligence 21, 8, 690–706. http://server.cs.ucf.edu/~vision/faculty/shah.html. Google ScholarDigital Library
23. Zhang, L., Dugas-Phocion, G., Samson, J., and Seitz, S. 2001. Single view modeling of free-form scenes. In CVPR01, I:990–997.Google Scholar
