“A data-driven approach to four-view image-based hair modeling” by Zhang, Chai, Wu, Yang and Zhou

  • ©Meng Zhang, Menglei Chai, Hongzhi Wu, Hao Yang, and Kun Zhou

Conference:


Type:


Title:

    A data-driven approach to four-view image-based hair modeling

Session/Category Title: Faces & Hair

Presenter(s)/Author(s):


Moderator(s):


Abstract:


    We introduce a novel four-view image-based hair modeling method. Given four hair images taken from the front, back, left and right views as input, we first estimate the rough 3D shape of the hair observed in the input using a predefined database of 3D hair models, then synthesize a hair texture on the surface of the shape, from which the hair growing direction information is calculated and used to construct a 3D direction field in the hair volume. Finally, we grow hair strands from the scalp, following the direction field, to produce the 3D hair model, which closely resembles the hair in all input images. Our method does not require that all input images are from the same hair, enabling an effective way to create compelling hair models from images of considerably different hairstyles at different views. We demonstrate the efficacy of our method using a wide range of examples.

References:


    1. Connelly Barnes, Eli Shechtman, Adam Finkelstein, and Dan B Goldman. 2009. Patch-Match: A Randomized Correspondence Algorithm for Structural Image Editing. ACM Trans. Graph. 28, 3, Article 24 (July 2009), 11 pages.Google ScholarDigital Library
    2. Connelly Barnes, Eli Shechtman, Dan B. Goldman, and Adam Finkelstein. 2010. The Generalized Patchmatch Correspondence Algorithm. In ECCV’10. 29–43. Google ScholarCross Ref
    3. Pravin Bhat, Brian Curless, Michael Cohen, and C. Lawrence Zitnick. 2008. ECCV. 114–128.Google Scholar
    4. Volker Blanz and Thomas Vetter. 1999. A Morphable Model for the Synthesis of 3D Faces. In Proc. SIGGRAPH ’99. 187–194. Google ScholarDigital Library
    5. Chen Cao, Hongzhi Wu, Yanlin Weng, Tianjia Shao, and Kun Zhou. 2016. Real-time Facial Animation with Image-based Dynamic Avatars. ACM Trans. Graph. 35, 4 (2016), 126. Google ScholarDigital Library
    6. Menglei Chai, Linjie Luo, Kalyan Sunkavalli, Nathan Carr, Sunil Hadap, and Kun Zhou. 2015. High-quality hair modeling from a single portrait photo. ACM Trans. Graph. 34, 6 (2015), 204. Google ScholarDigital Library
    7. Menglei Chai, Tianjia Shao, Hongzhi Wu, Yanlin Weng, and Kun Zhou. 2016. AutoHair: Fully Automatic Hair Modeling from A Single Image. ACM Trans. Graph. 35, 4 (2016), 116. Google ScholarDigital Library
    8. Menglei Chai, Lvdi Wang, Yanlin Weng, Xiaogang Jin, and Kun Zhou. 2013. Dynamic hair manipulation in images and videos. ACM Trans. Graph. 32, 4 (2013), 75. Google ScholarDigital Library
    9. Menglei Chai, Lvdi Wang, Yanlin Weng, Yizhou Yu, Baining Guo, and Kun Zhou. 2012. Single-view hair modeling for portrait manipulation. ACM Trans. Graph. 31, 4 (2012), 116. Google ScholarDigital Library
    10. Nicolas Cherin, Frederic Cordier, and Mahmoud Melkemi. 2014. Modeling piecewise helix curves from 2D sketches. Computer-Aided Design 46 (2014), 258 — 262. Google ScholarDigital Library
    11. Soheil Darabi, Eli Shechtman, Connelly Barnes, Dan B. Goldman, and Pradeep Sen. 2012. Image Melding: Combining Inconsistent Images Using Patch-based Synthesis. ACM Trans. Graph. 31, 4, Article 82 (July 2012), 10 pages.Google ScholarDigital Library
    12. Matthew Fisher, Peter Schröder, Mathieu Desbrun, and Hugues Hoppe. 2007. Design of Tangent Vector Fields. ACM Trans. Graph. 26, 3, Article 56 (July 2007). Google ScholarDigital Library
    13. Tomas Lay Herrera, Arno Zinke, and Andreas Weber. 2012. Lighting hair from the inside: A thermal approach to hair reconstruction. ACM Trans. Graph. 31, 6 (2012), 146. Google ScholarDigital Library
    14. Liwen Hu, Chongyang Ma, Linjie Luo, and Hao Li. 2014. Robust hair capture using simulated examples. ACM Trans. Graph. 33, 4 (2014), 126. Google ScholarDigital Library
    15. Liwen Hu, Chongyang Ma, Linjie Luo, and Hao Li. 2015. Single-view hair modeling using a hairstyle database. ACM Trans. Graph. 34, 4 (2015), 125. Google ScholarDigital Library
    16. Liwen Hu, Chongyang Ma, Linjie Luo, Li-Yi Wei, and Hao Li. 2014. Capturing Braided Hairstyles. ACM Trans. Graph. 33, 6, Article 225 (Nov. 2014), 9 pages.Google ScholarDigital Library
    17. Wenzel Jakob, Jonathan T Moon, and Steve Marschner. 2009. Capturing hair assemblies fiber by fiber. ACM Trans. Graph. 28, 5 (2009), 164. Google ScholarDigital Library
    18. Tae-Yong Kim and Ulrich Neumann. 2002. Interactive Multiresolution Hair Modeling and Editing. ACM Trans. Graph. 21, 3 (July 2002), 620–629. Google ScholarDigital Library
    19. Yin Li, Jian Sun, Chi-Keung Tang, and Heung-Yeung Shum. 2004. Lazy Snapping. ACM Trans. Graph. 23, 3 (Aug. 2004), 303–308. Google ScholarDigital Library
    20. William E. Lorensen and Harvey E. Cline. 1987. Marching Cubes: A High Resolution 3D Surface Construction Algorithm. In SIGGRAPH ’87 (SIGGRAPH ’87). ACM, 163–169. Google ScholarDigital Library
    21. Linjie Luo, Hao Li, and Szymon Rusinkiewicz. 2013. Structure-aware hair capture. ACM Trans. Graph. 32, 4 (2013), 76. Google ScholarDigital Library
    22. Microsoft. 2017. UVAtlas. https://github.com/Microsoft/UVAtlas/. (2017).Google Scholar
    23. Sylvain Paris, Hector M. Briceño, and François X. Sillion. 2004. Capture of Hair Geometry from Multiple Images. ACM Trans. Graph. 23, 3 (Aug. 2004), 712–719. Google ScholarDigital Library
    24. Sylvain Paris, Will Chang, Oleg I Kozhushnyan, Wojciech Jarosz, Wojciech Matusik, Matthias Zwicker, and Frédo Durand. 2008. Hair photobooth: geometric and photometric acquisition of real hairstyles. ACM Trans. Graph. 27, 3 (2008), 30. Google ScholarDigital Library
    25. Sastien Valette and Jean-Marc Chassery. 2004. Approximated Centroidal Voronoi Diagrams for Uniform Polygonal Mesh Coarsening. Computer Graphics Forum 23, 3 (2004), 381–389. Google ScholarCross Ref
    26. Nuttapon Vanakittistien, Attawith Sudsang, and Nuttapong Chentanez. 2016. 3D Hair Model from Small Set of Images. In Proceedings of MIG. ACM, New York, NY, USA, 85–90. Google ScholarDigital Library
    27. Lvdi Wang, Yizhou Yu, Kun Zhou, and Baining Guo. 2009. Example-based Hair Geometry Synthesis. ACM Trans. Graph. 28, 3, Article 56 (July 2009), 9 pages. Google ScholarDigital Library
    28. Kelly Ward, Florence Bertails, Tae-Yong Kim, Stephen R Marschner, Marie-Paule Cani, and Ming C Lin. 2007. A survey on hair modeling: Styling, simulation, and rendering. IEEE Trans. Vis. Comp. Graph. 13, 2 (2007), 213–234. Google ScholarDigital Library
    29. Li-Yi Wei and Marc Levoy. 2001. Texture Synthesis over Arbitrary Manifold Surfaces. In SIGGRAPH ’01. ACM, 355–360. Google ScholarDigital Library
    30. Yichen Wei, Eyal Ofek, Long Quan, and Heung-Yeung Shum. 2005. Modeling Hair from Multiple Views. ACM Trans. Graph. 24, 3 (July 2005), 816–820. Google ScholarDigital Library
    31. Y. Wexler, E. Shechtman, and M. Irani. 2007. Space-Time Completion of Video. IEEE TPAMI 29, 3 (2007), 463–476. Google ScholarDigital Library
    32. Xuan Yu, Zhan Yu, Xiaogang Chen, and Jingyi Yu. 2014. A Hybrid image-CAD Based System for Modeling Realistic Hairstyles. In I3D ’14. ACM, 63–70. Google ScholarDigital Library
    33. Cem Yuksel, Scott Schaefer, and John Keyser. 2009. Hair meshes. ACM Trans. Graph. 28, 5 (2009), 166. Google ScholarDigital Library
    34. Hongkai Zhao. 2005. A fast sweeping method for eikonal equations. Mathematics of computation 74, 250 (2005), 603–627. Google ScholarCross Ref

ACM Digital Library Publication:


Overview Page: