“Woven Fabric Model Creation from a Single Image” by Guarnera, Hall, Chesnais and Glencross

  • ©Giuseppe Claudio Guarnera, Peter M. Hall, Alain Chesnais, and Mashhuda Glencross

Conference:


Type:


Title:

    Woven Fabric Model Creation from a Single Image

Session/Category Title: Textiles & Microstructures

Presenter(s)/Author(s):


Moderator(s):


Abstract:


    We present a fast, novel image-based technique for reverse engineering woven fabrics at a yarn level. These models can be used in a wide range of interior design and visual special effects applications. To recover our pseudo-Bidirectional Texture Function (BTF), we estimate the three-dimensional (3D) structure and a set of yarn parameters (e.g., yarn width, yarn crossovers) from spatial and frequency domain cues. Drawing inspiration from previous work [Zhao et al. 2012], we solve for the woven fabric pattern and from this build a dataset. In contrast, however, we use a combination of image space analysis and frequency domain analysis, and, in challenging cases, match image statistics with those from previously captured known patterns. Our method determines, from a single digital image, captured with a digital single-lens reflex (DSLR) camera under controlled uniform lighting, the woven cloth structure, depth, and albedo, thus removing the need for separately measured depth data. The focus of this work is on the rapid acquisition of woven cloth structure and therefore we use standard approaches to render the results.

    Our pipeline first estimates the weave pattern, yarn characteristics, and noise statistics using a novel combination of low-level image processing and Fourier analysis. Next, we estimate a 3D structure for the fabric sample using a first-order Markov chain and our estimated noise model as input, also deriving a depth map and an albedo. Our volumetric textile model includes information about the 3D path of the center of the yarns, their variable width, and hence the volume occupied by the yarns, and colors.

    We demonstrate the efficacy of our approach through comparison images of test scenes rendered using (a) the original photograph, (b) the segmented image, (c) the estimated weave pattern, and (d) the rendered result.

References:


    1. R. Adams and L. Bischof. 1994. Seeded region growing. IEEE Trans. Pattern Anal. Mach. Intell. 16, 6 (June 1994), 641–647. https://doi.org/10.1109/34.295913 
    2. M. Brown and D. G. Lowe. 2007. Automatic panoramic image stitching using invariant features. Int. J. Comput. Vis. 74, 1 (2007), 59–73. 
    3. Kristin J. Dana, Bram van Ginneken, Shree K. Nayar, and Jan J. Koenderink. 1999. Reflectance and texture of real-world surfaces. ACM Trans. Graph. 18, 1 (Jan. 1999), 1–34. 
    4. S. R. Deans. 1983. The Radon Transform and Some of Its Applications. Wiley.
    5. Inderjit S. Dhillon and Suvrit Sra. 2003. Modeling Data Using Directional Distributions. Technical Report.
    6. J. Filip and M. Haindl. 2009. Bidirectional texture function modeling: A state of the art survey. IEEE Trans. Pattern Anal. Mach. Intell. 31, 11 (Nov 2009), 1921–1940. https://doi.org/10.1109/TPAMI.2008.246 
    7. Paul F. Fougère. 2012. Maximum Entropy and Bayesian Methods. Vol. 39. Springer Science 8 Business Media.
    8. Mashhuda Glencross, Gregory J. Ward, Francho Melendez, Caroline Jay, Jun Liu, and Roger Hubbold. 2008. A perceptually validated model for surface depth hallucination. ACM Trans. Graph. 27, 3, Article 59 (Aug. 2008), 8 pages. 
    9. Chang-Chiun Huang, Sun-Chong Liu, and Wen-Hong Yu. 2000. Woven fabric analysis by image processing part I: Identification of weave patterns. Textile Res. J. 70, 6 (2000), 481–485. 
    10. Piti Irawan and Steve Marschner. 2012. Specular reflection from woven cloth. ACM Trans. Graph. 31, 1, Article 11 (Feb. 2012), 20 pages. https://doi.org/10.1145/2077341.2077352
    11. K. Jafari-Khouzani and H. Soltanian-Zadeh. 2005. Radon transform orientation estimation for rotation invariant texture analysis. IEEE Trans. Pattern Anal. Mach. Intell. 27, 6 (June 2005), 1004–1008. https://doi.org/10.1109/TPAMI.2005.126. 
    12. Mizuho Kinoshita, Yositada Hashimoto, Ryuichi Akiyama, and Sei Uchiyama. 1989. Determination of weave type in woven fabric by digital image processing. J. Textile Mach. Soc. Jpn. 35, 2 (1989), 1–4. https://doi.org/10.4188/jte1955.35.2_1. 
    13. Kuo, Chung-Yang Shih, and Jiunn-Yih Lee. 2004. Automatic recognition of fabric weave patterns by a fuzzy C-means clustering method. Textile Res. J. 74, 2 (2004), 107–111. https://doi.org/10.1177/004051750407400204 arXiv:http://trj.sagepub.com/content/74/2/107.full.pdf+html. 
    14. Sebastian Magda and David Kriegman. 2006. Reconstruction of volumetric surface textures for real-time rendering. In Proceedings of the 17th Eurographics Conference on Rendering Techniques (EGSR’06). Tomas Akenine-Möller and Wolfgang Heidrich (Eds.). Eurographics Association, 19–29. http://dx.doi.org/10.2312/EGWR/EGSR06/019-029
    15. T. Ojala, M. Pietikainen, and T. Maenpaa. 2002. Multiresolution gray-scale and rotation invariant texture classification with local binary patterns. IEEE Trans. Pattern Anal. Mach. Intell. 24, 7 (Jul 2002), 971–987. https://doi.org/10.1109/TPAMI.2002.1017623 
    16. Ken Perlin. 1985. An image synthesizer. SIGGRAPH Comput. Graph. 19, 3 (July 1985), 287–296. https://doi.org/10.1145/325165.325247 
    17. Miquel Ralló, Jaume Escofet, and María S Millán. 2003. Weave-repeat identification by structural analysis of fabric images. Appl. Opt. 42, 17 (2003), 3361–3372. 
    18. S. A. Hosseini Ravandi and K Toriumi. 1995. Fourier transform analysis of plain weave fabric appearance. Textile Res. J. 65, 11 (1995), 676–683. 
    19. Erik Reinhard, Erum Arif Khan, Ahmet Oguz Akyz, and Garrett M. Johnson. 2008. Color Imaging: Fundamentals and Applications. A. K. Peters, Ltd., Natick, MA.
    20. C. J. Van Rijsbergen. 1979. Information Retrieval (2nd ed.). Butterworth-Heinemann, Newton, MA.
    21. J. Riviere, P. Peers, and A. Ghosh. 2016. Mobile surface reflectometry. Comput. Graph. Forum 35, 1 (2016), 191–202. https://doi.org/10.1111/cgf.12719 
    22. Iman Sadeghi, Oleg Bisker, Joachim De Deken, and Henrik Wann Jensen. 2013. A practical microcylinder appearance model for cloth rendering. ACM Trans. Graph. 32, 2, Article 14 (April 2013), 12 pages. https://doi.org/10.1145/2451236.2451240
    23. Bernhard Schölkopf, Alexander Smola, and Klaus-Robert Müller. 1998. Nonlinear component analysis as a kernel eigenvalue problem. Neur. Comput. 10, 5 (July 1998), 1299–1319. https://doi.org/10.1162/089976698300017467
    24. K. Schröder, A. Zinke, and R. Klein. 2015. Image-based reverse engineering and visual prototyping of woven cloth. IEEE Trans. Vis. Comput. Graph. 21, 2 (Feb 2015), 188–200. https://doi.org/10.1109/TVCG.2014.2339831 
    25. Christopher Schwartz, Ralf Sarlette, Michael Weinmann, and Reinhard Klein. 2013. DOME II: A parallelized BTF acquisition system. In Eurographics Workshop on Material Appearance Modeling: Issues and Acquisition, Holly Rushmeier and Reinhard Klein (Eds.). Eurographics Association, 25–31. https://doi.org/10.2312/MAM.MAM2013.025-031.
    26. Gaurav Sharma. 2002. Digital Color Imaging Handbook. CRC Press, Inc., Boca Raton, FL. 
    27. Marina Sokolova and Guy Lapalme. 2009. A systematic analysis of performance measures for classification tasks. Inf. Process. Manage. 45, 4 (July 2009), 427–437. https://doi.org/10.1016/j.ipm.2009.03.002. 
    28. Richard Szeliski. 2010. Computer Vision: Algorithms and Applications. Springer.
    29. B. J. Thompson. 1978. Optical transforms and coherent processing systems with insights from crystallography. In Optical Data Processing, David Casasent (Ed.). Topics in Applied Physics, Vol. 23. Springer, Berlin, 17–52. https://doi.org/10.1007/BFb0057982 
    30. Liwei Wang, Yan Zhang, and Jufu Feng. 2005. On the euclidean distance of images. IEEE Trans. Pattern Anal. Mach. Intell. 27, 8 (Aug. 2005), 1334–1339. https://doi.org/10.1109/TPAMI.2005.165 
    31. Gregory J. Ward. 2001. HDR Image Builder. Retrieved January 16, 2016 from http://www.anyhere.com.
    32. Gunter Wyszecki and Walter Stanley Stiles. 1982. Color Science: Concepts and Methods, Quantitative Data and Formulae. Vol. 8.
    33. Binjie Xin, Jinlian Hu, George Baciu, and Xiaobo Yu. 2009. Investigation on the classification of weave pattern based on an active grid model. Textile Res. J. 79, 12 (2009), 1123–1134. https://doi.org/10.1177/0040517508101459 arXiv:http://trj.sagepub.com/content/79/12/1123.full.pdf+html. 
    34. Shuang Zhao, Wenzel Jakob, Steve Marschner, and Kavita Bala. 2011. Building volumetric appearance models of fabric using micro CT imaging. In ACM Transactions on Graphics, Vol. 30. ACM, 44. 
    35. Shuang Zhao, Wenzel Jakob, Steve Marschner, and Kavita Bala. 2012. Structure-aware synthesis for predictive woven fabric appearance. ACM Trans. Graph. 31, 4, Article 75 (July 2012), 10 pages. https://doi.org/10.1145/2185520.2185571
    36. Shuang Zhao, Fujun Luan, and Kavita Bala. 2016. Fitting procedural yarn models for realistic cloth rendering. ACM Trans. Graph. 35, 4, Article 51 (July 2016), 11 pages. https://doi.org/10.1145/2897824.2925932
    37. Dejun Zheng, George Baciu, and Jinlian Hu. 2009. Accurate indexing and classification for fabric weave patterns using entropy-based approach. In Proceedings of the 8th IEEE International Conference on Cognitive Informatics 2009 (ICCI’09).. IEEE, 357–364.

ACM Digital Library Publication:


Overview Page: