“Garment modeling with a depth camera” by Chen, Zhou, Lu, Wang, Bi, et al. … – ACM SIGGRAPH HISTORY ARCHIVES

“Garment modeling with a depth camera” by Chen, Zhou, Lu, Wang, Bi, et al. …

  • 2015 SA Technical Papers_Chen_Garment Modeling with a Depth Camera

Conference:


Type(s):


Title:

    Garment modeling with a depth camera

Session/Category Title:   Modelling and More

Presenter(s)/Author(s):


Abstract:


    Previous garment modeling techniques mainly focus on designing novel garments to dress up virtual characters. We study the modeling of real garments and develop a system that is intuitive to use even for novice users. Our system includes garment component detectors and design attribute classifiers learned from a manually labeled garment image database. In the modeling time, we scan the garment with a Kinect and build a rough shape by KinectFusion from the raw RGBD sequence. The detectors and classifiers will identify garment components (e.g. collar, sleeve, pockets, belt, and buttons) and their design attributes (e.g. falbala collar or lapel collar, hubble-bubble sleeve or straight sleeve) from the RGB images. Our system also contains a 3D deformable template database for garment components. Once the components and their designs are determined, we choose appropriate templates, stitch them together, and fit them to the initial garment mesh generated by KinectFusion. Experiments on various different garment styles consistently generate high quality results.

References:


    1. Baran, I., and Popović, J. 2007. Automatic rigging and animation of 3d characters. ACM Trans. Graph. 26, 3, 72:1–72:8.
    2. Berthouzoz, F., Garg, A., Kaufman, D., Grinspun, E., and Agrawala, M. 2013. Parsing sewing patterns into 3d garments. ACM Trans. Graph. 32, 4, 85:1–85:12.
    3. Bouaziz, S., and Pauly, M., 2013. Dynamic 2d/3d registration for the kinect. ACM SIGGRAPH Courses.
    4. Bradley, D., Popa, T., Sheffer, A., Heidrich, W., and Boubekeur, T. 2008. Markerless garment capture. ACM Trans. Graph. 27, 3, 99:1–99:9.
    5. Breiman, L. 2001. Random forests. Mach. Learn. 45, 1, 5–32.
    6. Brouet, R., Sheffer, A., Boissieux, L., and Cani, M.-P. 2012. Design preserving garment transfer. ACM Trans. Graph. 31, 4, 36:1–36:11.
    7. Chaudhuri, S., and Koltun, V. 2010. Data-driven suggestions for creativity support in 3d modeling. ACM Trans. Graph. 29, 6, 183:1–183:9.
    8. Chaudhuri, S., Kalogerakis, E., Guibas, L., and Koltun, V. 2011. Probabilistic reasoning for assembly-based 3d modeling. ACM Trans. Graph. 30, 4, 35:1–35:9.
    9. Chen, K., Lai, Y.-K., Wu, Y.-X., Martin, R., and Hu, S.-M. 2014. Automatic semantic modeling of indoor scenes from low-quality rgb-d data using contextual information. ACM Trans. Graph. 33, 6, 208:1–208:12.
    10. Choi, K.-J., and Ko, H.-S. 2000. Online motion retargetting. The Journal of Visualization and Computer Animation (Special issue of Pacific Graphics ’99) 11, 5, 223–235.
    11. Cordier, F., Seo, H., and Magnenat-Thalmann, N. 2003. Made-to-measure technologies for online clothing store. Comput. Graph. Appl. 23, 1.
    12. Dalal, N., and Triggs, B. 2005. Histograms of oriented gradients for human detection. In Proc. CVPR, 886–893.
    13. Decaudin, P., Julius, D., Wither, J., Boissieux, L., Sheffer, A., and Cani, M.-P. 2006. Virtual garments: A fully geometric approach for clothing design. Comput. Graph. Forum 25, 3, 625–634.
    14. Divivier, A., Trieb, R., Ebert, A., and Etc. 2004. Virtual try-on: Topics in realistic, individualized dressing in virtual reality. In Proc. Virtual and Augmented Reality Status Conf.
    15. Dou, M., Taylor, J., Fuchs, H., Fitzgibbon, A., and Izadi, S. 2015. 3d scanning deformable objects with a single rgbd sensor. In Proc. CVPR, 493–501.
    16. Felzenszwalb, P. F., Girshick, R. B., McAllester, D., and Ramanan, D. 2010. Object detection with discriminatively trained part based models. IEEE Trans. Pattern Anal. Mach. Intell. 32, 9, 1627–1645.
    17. Fisher, M., Ritchie, D., Savva, M., Funkhouser, T., and Hanrahan, P. 2012. Example-based synthesis of 3d object arrangements. ACM Trans. Graph. 31, 6, 135:1–135:11.
    18. Fontana, M., Carubelli, A., Rizzi, C., and Cugini, U. 2005. Clothassembler: a cad module for feature-based garment pattern assembly. Computer-Aided Design and Applications 2, 6, 795–804.
    19. Funkhouser, T., Kazhdan, M., Shilane, P., Min, P., Kiefer, W., Tal, A., Rusinkiewicz, S., and Dobkin, D. 2004. Modeling by example. ACM Trans. Graph. 23, 3, 652–663.
    20. Girshick, R. B., Felzenszwalb, P. F., and McAllester, D., 2012. Discriminatively trained deformable part models release 5. http://people.cs.uchicago.edu/rbg/latent-release5/.
    21. Guan, P., Reiss, L., Hirshberg, D. A., Weiss, A., and Black, M. J. 2012. Drape: Dressing any person. ACM Trans. Graph. 31, 4, 35:1–35:10.
    22. Ingham, R., and Covey, L. 1992. Costume Designer’s Handbook: A Complete Guide for Amateur and Professional Costume Designers. Prentice-Hall Inc.
    23. Intel, 2013. The open source probabilistic networks library. http://sourceforge.net/projects/openpnl/.
    24. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. 2011. Kinectfusion: Real-time 3d reconstruction and interaction using a moving depth camera. In Proc. ACM Symposium on User Interface Software and Technology, 559–568.
    25. Kalogerakis, E., Chaudhuri, S., Koller, D., and Koltun, V. 2012. A probabilistic model for component-based shape synthesis. ACM Trans. Graph. 31, 4, 55:1–55:11.
    26. Li, Y., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Lazy snapping. ACM Trans. Graph. 23, 3, 303–308.
    27. Li, H., Vouga, E., Gudym, A., Luo, L., Barron, J. T., and Gusev, G. 2013. 3d self-portraits. ACM Trans. Graph. 32, 6, 187:1–187:9.
    28. Liu, S., Song, Z., Liu, G., Xu, C., Lu, H., and Yan, S. 2012. Street-to-shop: Cross-scenario clothing retrieval via parts alignment and auxiliary set. In Proc. CVPR, 3330–3337.
    29. Meng, Y., Mok, P., and Jin, X. 2012. Computer aided clothing pattern design with 3d editing and pattern alteration. Computer-Aided Design 44, 8, 721–734.
    30. MIT, and Wall, M., 2007. Galib: Matthew’s genetic algorithms library. http://lancet.mit.edu/ga/.
    31. Mok, P., Xu, J., Wang, X., Fan, J., Kwok, Y., and Xin, J. H. 2013. An iga-based design support system for realistic and practical fashion designs. Computer-Aided Design 45, 11, 1442–1458.
    32. Popa, T., Zhou, Q., Bradley, D., Kraevoy, V., Fu, H., Sheffer, A., and Heidrich, W. 2009. Wrinkling captured garments using space-time data-driven deformation. Comput. Graph. Forum 28, 2, 427–435.
    33. Robson, C., Maharik, R., Sheffer, A., and Carr, N. 2011. Context-aware garment modeling from sketches. Comput. and Graph. 35, 3, 604–613.
    34. Scholz, V., Stich, T., Keckeisen, M., Wacker, M., and Magnor, M. 2005. Garment motion capture using color-coded patterns. Comput. Graph. Forum 24, 3, 439–447.
    35. Shao, T., Xu, W., Zhou, K., Wang, J., Li, D., and Guo, B. 2012. An interactive approach to semantic modeling of indoor scenes with an rgbd camera. ACM Trans. Graph. 31, 6, 136:1–136:11.
    36. Shen, C.-H., fu, H., Chen, K., and Hu, S.-M. 2012. Structure recovery by part assembly. ACM Trans. Graph. 31, 4, 180:1–180:11.
    37. Sumner, R. W., and Popović, J. 2004. Deformation transfer for triangle meshes. ACM Trans. Graph. 23, 3, 399–405.
    38. Turquin, E., Cani, M.-P., and Hughes, J. F. 2004. Sketching garments for virtual characters. In Proc. Eurographics Workshop on Sketch-Based Interfaces and Modeling, 175–182.
    39. Turquin, E., Wither, J., Boissieux, L., Cani, M.-P., and Hughes, J. F. 2007. A sketch-based interface for clothing virtual characters. Comput. Graph. Appl. 27, 1, 72–81.
    40. Umetani, N., Kaufman, D. M., Igarashi, T., and Grinspun, E. 2011. Sensitive couture for interactive garment editing and modeling. ACM Trans. Graph. 30, 4, 90:1–90:11.
    41. Volino, P., and Magnenat-Thalmann, N. 2005. Accurate garment prototyping and simulation. Computer-Aided Design and Applications 2, 5, 645–654.
    42. Wang, C. C., Wang, Y., and Yuen, M. M. 2003. Feature based 3d garment design through 2d sketches. Computer-Aided Design 35, 7, 659–672.
    43. Wang, X., Han, T. X., and Yan, S. 2009. An hog-lbp human detector with partial occlusion handling. In Proc. ICCV, 32–39.
    44. White, R., Crane, K., and Forsyth, D. A. 2007. Capturing and animating occluded cloth. ACM Trans. Graph. 26, 3, 34:1–34:8.
    45. Yamaguchi, K., Kiapour, M. H., Ortiz, L. E., and Berg, T. L. 2012. Parsing clothing in fashion photographs. In Proc. CVPR, 3570–3577.
    46. Yamaguchi, K., Kiapour, M. H., Ortiz, L. E., and Berg, T. L. 2015. Retrieving similar styles to parse clothing. IEEE Trans. Pattern Anal. Mach. Intell. 37, 5, 1028–1040.
    47. Yang, W., Luo, P., and Lin, L. 2014. Clothing co-parsing by joint image segmentation and labeling. In Proc. CVPR, 3182–3189.
    48. Yu, Y., Zhou, K., Xu, D., Shi, X., Bao, H., Guo, B., and Eung Shum, H.-Y. 2004. Mesh editing with poisson-based gradient field manipulation. ACM Trans. Graph. 23, 3, 644–651.
    49. Zhou, B., Chen, X., Fu, Q., Guo, K., and Tan, P. 2013. Garment modeling from a single image. Comput. Graph. Forum 32, 7, 85–91.
    50. Zuffi, S., and Black, M. J. 2015. The stitched puppet: A graphical model of 3d human shape and pose. In Proc. CVPR, 3537–3546.

ACM Digital Library Publication:


Overview Page:


Submit a story:

If you would like to submit a story about this presentation, please contact us: historyarchives@siggraph.org