“The space of human body shapes: reconstruction and parameterization from range scans” by Allen, Curless and Popovic

We develop a novel method for fitting high-resolution template meshes to detailed human body range scans with sparse 3D markers. We formulate an optimization problem in which the degrees of freedom are an affine transformation at each template vertex. The objective function is a weighted combination of three measures: proximity of transformed vertices to the range data, similarity between neighboring transformations, and proximity of sparse markers at corresponding locations on the template and target surface. We solve for the transformations with a non-linear optimizer, run at two resolutions to speed convergence. We demonstrate reconstruction and consistent parameterization of 250 human body models. With this parameterized set, we explore a variety of applications for human body modeling, including: morphing, texture transfer, statistical analysis of shape, model fitting from sparse markers, feature analysis to modify multiple correlated parameters (such as the weight and height of an individual), and transfer of surface detail and animation controls from a template to fitted models.

1. ALLEN, B., CURLESS, B., AND POPOVIĆ, Z. 2002. Articulated body deformation from range scan data. 612–619. Google Scholar
2. BLANZ, V., AND VETTER, T. 1999. A morphable model for the synthesis of 3D faces. In Proceedings of ACM SIGGRAPH 99, ACM Press/Addison-Wesley Publishing Co., New York, A. Rockwood, Ed., Computer Graphics Proceedings, Annual Conference Series, 187–194. Google Scholar
3. CARR, J. C., BEATSON, R. K., CHERRIE, J. B., MITCHELL, T. J., FRIGHT, W. R., MCCALLUM, B. C., AND EVANS, T. R. 2001. Reconstruction and representation of 3D objects with radial basis functions. In Proceedings of ACM SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, New York, E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, 67–76. Google Scholar
4. DAVIS, J., MARSCHNER, S. R., GARR, M., AND LEVOY, M. 2002. Filling holes in complex surfaces using volumetric diffusion. In Proc. First International Symposium on 3D Data Processing, Visualization, and Transmission.Google Scholar
5. DECARLO, D., METAXAS, D., AND STONE, M. 1998. An anthropometric face model using variational techniques. In Proceedings of ACM SIGGRAPH 98, ACM Press, Computer Graphics Proceedings, Annual Conference Series, 67–74. Google Scholar
6. FELDMAR, J., AND AYACHE, N. 1994. Rigid and affine registration of smooth surfaces using differential properties. In ECCV (2), 397–406. Google Scholar
7. HILTON, A., STARCK, J., AND COLLINS, G. 2002. From 3D shape capture to animated models. In Proc. First International Symposion on 3D Data Processing, Visualization, and Transmission (3DPVT 2002).Google ScholarCross Ref
8. KÄHLER, K., HABER, J., YAMAUCHI, H., AND SEIDEL, H.-P. 2002. Head shop: Generating animated head models with anatomical structure. In Proceedings of the 2002 ACM SIGGRAPH Symposium on Computer Animation, ACM SIGGRAPH, San Antonio, USA, S. N. Spencer, Ed., Association of Computing Machinery (ACM), 55–64. Google Scholar
9. LEE, A. W. F., SWELDENS, W., SCHRÖDER, P., COWSAR, L., AND DOBKIN, D. 1998. MAPS: Multiresolution adaptive parameterization of surfaces. In Proceedings of ACM SIGGRAPH 98, ACM Press, Computer Graphics Proceedings, Annual Conference Series, 95–104. Google Scholar
10. LEE, A., MORETON, H., AND HOPPE, H. 2000. Displaced subdivision surfaces. In Proceedings of ACM SIGGRAPH 2000, ACM Press / ACM SIGGRAPH / Addison Wesley Longman, K. Akeley, Ed., Computer Graphics Proceedings, Annual Conference Series, 85–94. Google Scholar
11. LEWIS, J. P., CORDNER, M., AND FONG, N. 2000. Pose space deformations: A unified approach to shape interpolation and skeleton-driven deformation. In Proceedings of ACM SIGGRAPH 2000, ACM Press / ACM SIGGRAPH / Addison Wesley Longman, K. Akeley, Ed., Computer Graphics Proceedings, Annual Conference Series, 165–172. Google Scholar
12. MARSCHNER, S. R., GUENTER, B., AND RAGHUPATHY, S. 2000. Modeling and rendering for realistic facial animation. In Proceedings of 11th Eurographics Workshop on Rendering, 231–242. Google ScholarCross Ref
13. PRAUN, E., SWELDENS, W., AND SCHRÖDER, P. 2001. Consistent mesh parameterizations. In Proceedings of ACM SIGGRAPH 2001, ACM Press / ACM SIGGRAPH, New York, E. Fiume, Ed., Computer Graphics Proceedings, Annual Conference Series, 179–184. Google Scholar
14. SHELDON, W. H., STEVENS, S. S., AND TUCKER, W. B. 1940. The Varieties of Human Physique. Harper & Brothers Publishers, New York.Google Scholar
15. SLOAN, P.-P., ROSE, C., AND COHEN, M. F. 2001. Shape by example. In Proceedings of 2001 Symposium on Interactive 3D Graphics, 135–143. Google Scholar
16. SZELISKI, R., AND LAVALLÉE, S. 1994. Matching 3-D anatomical surfaces with non-rigid deformations using octree-splines. In IEEE Workshop on Biomedical Image Analysis, IEEE Computer Society, 144–153.Google Scholar
17. TURK, G., AND LEVOY, M. 1994. Zippered polygon meshes from range images. In Proceedings of ACM SIGGRAPH 94, ACM Press, Computer Graphics Proceedings, Annual Conference Series, 311–318. Google Scholar
18. TURK, M., AND PENTLAND, A. 1991. Eigenfaces for recognition. Journal of Cognitive Neuroscience 3, 1, 71–86.Google ScholarDigital Library
19. WHITAKER, R. 1998. A level-set approach to 3-D reconstruction from range data. International Journal of Computer Vision 29, 3, 203–231. Google ScholarCross Ref
20. ZHU, C., BYRD, R. H., LU, P., AND NOCEDAL, J. 1997. Algorithm 778. L-BFGS-B: Fortran subroutines for Large-Scale bound constrained optimization. ACM Transactions on Mathematical Software 23, 4 (Dec.), 550–560. Google ScholarDigital Library