“Single-view hair modeling for portrait manipulation” by Chai, Wang, Weng, Yu, Guo, et al. …

Human hair is known to be very difficult to model or reconstruct. In this paper, we focus on applications related to portrait manipulation and take an application-driven approach to hair modeling. To enable an average user to achieve interesting portrait manipulation results, we develop a single-view hair modeling technique with modest user interaction to meet the unique requirements set by portrait manipulation. Our method relies on heuristics to generate a plausible high-resolution strand-based 3D hair model. This is made possible by an effective high-precision 2D strand tracing algorithm, which explicitly models uncertainty and local layering during tracing. The depth of the traced strands is solved through an optimization, which simultaneously considers depth constraints, layering constraints as well as regularization terms. Our single-view hair modeling enables a number of interesting applications that were previously challenging, including transferring the hairstyle of one subject to another in a potentially different pose, rendering the original portrait in a novel view and image-space hair editing.

1. Barnes, C., Shechtman, E., Finkelstein, A., and Goldman, D. B. 2009. PatchMatch: A randomized correspondence algorithm for structural image editing. ACM Trans. Graph. 28, 3, 24:1–24:11. Google ScholarDigital Library
2. Bitouk, D., Kumar, N., Dhillon, S., Belhumeur, P. N., and Nayar, S. K. 2008. Face Swapping: Automatically replacing faces in photographs. ACM Trans. Graph. 27, 39:1–39:8. Google ScholarDigital Library
3. Blanz, V., and Vetter, T. 1999. A morphable model for the synthesis of 3D faces. In Proceedings of SIGGRAPH ’99, 187–194. Google ScholarDigital Library
4. Bonneel, N., Paris, S., Panne, M. V. D., Durand, F., and Drettakis, G. 2009. Single photo estimation of hair appearance. Computer Graphics Forum 28, 1171–1180. Google ScholarDigital Library
5. Canny, J. 1983. Finding Edges and Lines in Images. Master’s thesis, MIT. http://hdl.handle.net/1721.1/6939.Google Scholar
6. Dale, K., Sunkavalli, K., Johnson, M. K., Vlasic, D., Matusik, W., and Pfister, H. 2011. Video face replacement. ACM Trans. Graph. 30, 6, 130:1–130:10. Google ScholarDigital Library
7. Hoiem, D., Efros, A. A., and Hebert, M. 2005. Automatic photo pop-up. ACM Trans. Graph. 24, 3, 577–584. Google ScholarDigital Library
8. Jain, A. K., and Farrokhnia, F. 1991. Unsupervised texture segmentation using Gabor filters. Pattern Recognition 24, 12, 1167–1186. Google ScholarDigital Library
9. Jain, A., Thormählen, T., Seidel, H.-P., and Theobalt, C. 2010. MovieReshape: Tracking and reshaping of humans in videos. ACM Trans. Graph. 29, 6, 148:1–148:10. Google ScholarDigital Library
10. Jakob, W., Moon, J. T., and Marschner, S. 2009. Capturing hair assemblies fiber by fiber. ACM Trans. Graph. 28, 5, 164:1–164:9. Google ScholarDigital Library
11. Joshi, N., Matusik, W., Adelson, E. H., and Kriegman, D. J. 2010. Personal photo enhancement using example images. ACM Trans. Graph. 29, 3, 12:1–12:15. Google ScholarDigital Library
12. Levin, A., Lischinski, D., and Weiss, Y. 2008. A closed-form solution to natural image matting. IEEE Transactions on Pattern Analysis and Machine Intelligence 30, 2, 228–242. Google ScholarDigital Library
13. Leyvand, T., Cohen-Or, D., Dror, G., and Lischinski, D. 2008. Data-driven enhancement of facial attractiveness. ACM Trans. Graph. 27, 3, 38:1–38:9. Google ScholarDigital Library
14. Li, Y., Sun, J., Tang, C., and Shum, H. 2004. Lazy snapping. ACM Trans. Graph. 23, 3, 303–308. Google ScholarDigital Library
15. Marschner, S., Jensen, H. W., Cammarano, M., Worley, S., and Hanrahan, P. 2003. Light scattering from human hair fibers. ACM Trans. Graph. 22, 3, 780–791. Google ScholarDigital Library
16. Milborrow, S., and Nicolls, F. 2008. Locating facial features with an extended active shape model. In Proceedings of ECCV ’08, Springer, 504–513. Google ScholarDigital Library
17. Nguyen, H., and Donnelly, W. 2004. Hair animation and rendering in the Nalu demo. In GPU Gems 2. Addison-Wesley Professional.Google Scholar
18. Öztireli, A. C., Uyumaz, U., Popa, T., Sheffer, A., and Gross, M. 2011. 3D modeling with a symmetric sketch. In Proceedings of SBIM, 23–30. Google ScholarDigital Library
19. Paris, S., Briceño, H., and Sillion, F. 2004. Capture of hair geometry from multiple images. ACM Trans. Graph. 23, 3, 712–719. Google ScholarDigital Library
20. Paris, S., Chang, W., Kozhushnyan, O. I., Jarosz, W., Matusik, W., Zwicker, M., and Durand, F. 2008. Hair photobooth: geometric and photometric acquisition of real hairstyles. ACM Trans. Graph. 27, 3, 30:1–30:9. Google ScholarDigital Library
21. Pighin, F., and Lewis, J. P. 2006. Performance-driven facial animation. In ACM SIGGRAPH 2006 Courses.Google Scholar
22. Rivers, A., Igarashi, T., and Durand, F. 2010. 2.5D cartoon models. ACM Trans. Graph. 29, 4, 59:1–59:7. Google ScholarDigital Library
23. Shlizerman, I. K., Shechtman, E., Garg, R., and Seitz, S. M. 2010. Being John Malkovich. In Proceedings of ECCV ’10, 341–353. Google ScholarDigital Library
24. Shlizerman, I. K., Shechtman, E., Garg, R., and Seitz, S. M. 2011. Exploring photobios. ACM Trans. Graph. 30, 4, 61:1–61:9. Google ScholarDigital Library
25. Ward, K., Bertails, F., Kim, T.-Y., Marschner, S. R., Cani, M.-P., and Lin, M. C. 2007. A survey on hair modeling: styling, simulation, and rendering. IEEE Transactions on Visualization and Computer Graphics 13, 2, 213–234. Google ScholarDigital Library
26. Wei, Y., Ofek, E., Quan, L., and Shum, H.-Y. 2005. Modeling hair from multiple views. ACM Trans. Graph. 24, 3, 816–820. Google ScholarDigital Library
27. Xu, K., Ma, L.-Q., Ren, B., Wang, R., and Hu, S.-M. 2011. Interactive hair rendering and appearance editing under environment lighting. ACM Trans. Graph. 30, 6, 173:1–173:10. Google ScholarDigital Library
28. Yang, F., Wang, J., Shechtman, E., Bourdev, L., and Metaxas, D. 2011. Expression flow for 3D-aware face component transfer. ACM Trans. Graph. 30, 4, 60:1–60:10. Google ScholarDigital Library
29. Yu, Y. 2001. Modeling realistic virtual hairstyles. In Proceedings of Pacific Graphics ’01, 295–304. Google ScholarDigital Library
30. Zhou, S., Fu, H., Liu, L., Cohen-Or, D., and Han, X. 2010. Parametric reshaping of human bodies in images. ACM Trans. Graph. 29, 4, 126:1–126:10. Google ScholarDigital Library