“Capturing and stylizing hair for 3D fabrication” by Echevarria, Bradley, Gutierrez and Beeler
Conference:
Type(s):
Title:
- Capturing and stylizing hair for 3D fabrication
Session/Category Title: Hair & Collisions
Presenter(s)/Author(s):
Moderator(s):
Abstract:
Recently, we have seen a growing trend in the design and fabrication of personalized figurines, created by scanning real people and then physically reproducing miniature statues with 3D printers. This is currently a hot topic both in academia and industry, and the printed figurines are gaining more and more realism, especially with state-of-the-art facial scanning technology improving. However, current systems all contain the same limitation – no previous method is able to suitably capture personalized hair-styles for physical reproduction. Typically, the subject’s hair is approximated very coarsely or replaced completely with a template model. In this paper we present the first method for stylized hair capture, a technique to reconstruct an individual’s actual hair-style in a manner suitable for physical reproduction. Inspired by centuries-old artistic sculptures, our method generates hair as a closed-manifold surface, yet contains the structural and color elements stylized in a way that captures the defining characteristics of the hair-style. The key to our approach is a novel multi-view stylization algorithm, which extends feature-preserving color filtering from 2D images to irregular manifolds in 3D, and introduces abstract geometric details that are coherent with the color stylization. The proposed technique fits naturally in traditional pipelines for figurine reproduction, and we demonstrate the robustness and versatility of our approach by capturing several subjects with widely varying hair-styles.
References:
1. 3D-u, 2010. ThreeDee-You. http://www.3d-u.es/. Accessed: January 18, 2014.Google Scholar
2. 3DSystems, 2013. 3DMe Photobooth. http://www. 3dsystems.com/. Accessed: January 10, 2014.Google Scholar
3. Beeler, T., Bickel, B., Beardsley, P., Sumner, B., and Gross, M. 2010. High-quality single-shot capture of facial geometry. ACM Trans. Graph. 29, 3, 40:1–40:9. Google ScholarDigital Library
4. Beeler, T., Bickel, B., Noris, G., Beardsley, P., Marschner, S., Sumner, R. W., and Gross, M. 2012. Coupled 3D reconstruction of sparse facial hair and skin. ACM Trans. Graph. 31, 4, 117:1–117:10. Google ScholarDigital Library
5. Besl, P. J., and McKay, N. D. 1992. A method for registration of 3-D shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 2, 239–256. Google ScholarDigital Library
6. Brox, T., Boomgaard, R., Lauze, F., Weijer, J., Weickert, J., Mrzek, P., and Kornprobst, P. 2006. Adaptive structure tensors and their applications. In Visualization and Processing of Tensor Fields, Mathematics and Visualization. 17–47.Google Scholar
7. Cabral, B., and Leedom, L. C. 1993. Imaging vector fields using line integral convolution. In Proceedings of the 20th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’93, 263–270. Google ScholarDigital Library
8. Chai, M., Wang, L., Weng, Y., Yu, Y., Guo, B., and Zhou, K. 2012. Single-view hair modeling for portrait manipulation. ACM Trans. Graph. 31, 4, 116:1–116:8. Google ScholarDigital Library
9. Chai, M., Wang, L., Weng, Y., Jin, X., and Zhou, K. 2013. Dynamic hair manipulation in images and videos. ACM Trans. Graph. 32, 4, 75:1–75:8. Google ScholarDigital Library
10. D-Tech Me, 2012. D-tech me. http://www.insidethemagic.net/tag/d-tech-me/. Accessed: January 18, 2014.Google Scholar
11. Grabli, S., Sillion, F., Marschner, S. R., and Lengyel, J. E. 2002. Image-based hair capture by inverse lighting. In Proc. Graphics Interface, 51–58.Google Scholar
12. Herrera, T. L., Zinke, A., and Weber, A. 2012. Lighting hair from the inside: A thermal approach to hair reconstruction. ACM Trans. Graph. 31, 6, 146:1–146:9. Google ScholarDigital Library
13. Hu, L., Ma, C., Luo, L., and Li, H. 2014. Robust hair capture using simulated examples. ACM Trans. Graph. 33, 4. Google ScholarDigital Library
14. Jakob, W., Moon, J. T., and Marschner, S. 2009. Capturing hair assemblies fiber by fiber. ACM Trans. Graph. 28, 5, 164:1–164:9. Google ScholarDigital Library
15. Kang, H., and Lee, S. 2008. Shape-simplifying image abstraction. Computer Graphics Forum 27, 7, 1773–1780.Google ScholarCross Ref
16. Kang, H., Lee, S., and Chui, C. K. 2009. Flow-based image abstraction. IEEE Transactions on Visualization and Computer Graphics 15, 1, 62–76. Google ScholarDigital Library
17. Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. In Symposium on Geometry Processing, 61–70. Google ScholarDigital Library
18. Kong, W., Takahashi, H., and Nakajima, M. 1997. Generation of 3D hair model from multiple pictures. In Proc. Multimedia Modeling, 183–196.Google Scholar
19. Kyprianidis, J. E., and Kang, H. 2011. Image and video abstraction by coherence-enhancing filtering. Computer Graphics Forum 30, 2, 593–602.Google ScholarCross Ref
20. Kyprianidis, J. E., Collomosse, J., Wang, T., and Isenberg, T. 2013. State of the Art: A taxonomy of artistic stylization techniques for images and video. IEEE Transactions on Visualization and Computer Graphics 19, 5, 866–885. Google ScholarDigital Library
21. Lefebvre, S., and Hoppe, H. 2006. Appearance-space texture synthesis. ACM Trans. Graph. 25, 3, 541–548. Google ScholarDigital Library
22. Li, H., Vouga, E., Gudym, A., Luo, L., Barron, J. T., and Gusev, G. 2013. 3D Self-portraits. ACM Trans. Graph. 32, 6, 187:1–187:9. Google ScholarDigital Library
23. Luo, L., Li, H., Sylvain, Weise, T., Pauly, M., and Rusinkiewicz, S. 2012. Multi-view hair capture using orientation fields. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 1490–1497. Google ScholarDigital Library
24. Luo, L., Li, H., and Rusinkiewicz, S. 2013. Structure-aware hair capture. ACM Trans. Graph. 32, 4, 76:1–76:12. Google ScholarDigital Library
25. Mehra, R., Zhou, Q., Long, J., Sheffer, A., Gooch, A., and Mitra, N. J. 2009. Abstraction of man-made shapes. ACM Trans. Graph. 28, 5, 137:1–137:10. Google ScholarDigital Library
26. Nan, L., Sharf, A., Xie, K., Wong, T.-T., Deussen, O., Cohen-Or, D., and Chen, B. 2011. Conjoining gestalt rules for abstraction of architectural drawings. ACM Trans. Graph. 30, 6. 185:1-185:10. Google ScholarDigital Library
27. Omote 3D, 2012. Omote 3D. http://www.omote3d.com/. Accessed: January 18, 2014.Google Scholar
28. Osher, S., and Rudin, L. I. 1990. Feature-oriented image enhancement using shock filters. SIAM Journal on Numerical Analysis 27, 4, 919–940. Google ScholarDigital Library
29. Paris, S., Briceño, H. M., and Sillion, F. X. 2004. Capture of hair geometry from multiple images. ACM Trans. Graph. 23, 3, 712–719. Google ScholarDigital Library
30. Paris, S., Chang, W., Kozhushnyan, O. I., Jarosz, W., Matusik, W., Zwicker, M., and Durand, F. 2008. Hair photobooth: Geometric and photometric acquisition of real hairstyles. ACM Trans. Graph. 27, 3, 30:1–30:9. Google ScholarDigital Library
31. PocketSize Me, 2013. PocketSize Me. http://www.pocketsizeme.ch/. Accessed: January 18, 2014.Google Scholar
32. Sochen, N., Deriche, R., and Perez, L. 2003. The beltrami flow over implicit manifolds. In Ninth IEEE International Conference on Computer Vision (ICCV), vol. 3, 832–839. Google ScholarDigital Library
33. Sturm, J., Bylow, E., Kahl, F., and Cremers, D. 2013. CopyMe3D: Scanning and printing persons in 3D. In Pattern Recognition, vol. 8142. 405–414.Google Scholar
34. Tena, J. R., Mahler, M., Beeler, T., Grosse, M., Yeh, H., and Matthews, I. 2013. Fabricating 3D figurines with personalized faces. IEEE Computer Graphics and Applications 33, 6, 36–46. Google ScholarDigital Library
35. Wang, L., Yu, Y., Zhou, K., and Guo, B. 2009. Example-based hair geometry synthesis. ACM Trans. Graph. 28, 3, 56:1–56:9. Google ScholarDigital Library
36. Wei, L.-Y., and Levoy, M. 2001. Texture synthesis over arbitrary manifold surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques, SIGGRAPH ’01, 355–360. Google ScholarDigital Library
37. Wei, Y., Ofek, E., Quan, L., and Shum, H.-Y. 2005. Modeling hair from multiple views. ACM Trans. Graph. 24, 3, 816–820. Google ScholarDigital Library
38. Weickert, J. 2003. Coherence-enhancing shock filters. In Pattern Recognition, vol. 2781 of Lecture Notes in Computer Science. 1–8.Google Scholar
39. Yumer, M. E., and Kara, L. B. 2012. Co-abstraction of shape collections. ACM Trans. Graph. 31, 6, 166:1–166:11. Google ScholarDigital Library
