“Modeling by example” by Funkhouser, Kazhdan, Shilane, Min, Kiefer, et al. …

In this paper, we investigate a data-driven synthesis approach to constructing 3D geometric surface models. We provide methods with which a user can search a large database of 3D meshes to find parts of interest, cut the desired parts out of the meshes with intelligent scissoring, and composite them together in different ways to form new objects. The main benefit of this approach is that it is both easy to learn and able to produce highly detailed geometric models — the conceptual design for new models comes from the user, while the geometric details come from examples in the database. The focus of the paper is on the main research issues motivated by the proposed approach: (1) interactive segmentation of 3D surfaces, (2) shape-based search to find 3D models with parts matching a query, and (3) composition of parts to form new models. We provide new research contributions on all three topics and incorporate them into a prototype modeling system. Experience with our prototype system indicates that it allows untrained users to create interesting and detailed 3D models.

1. ALEXA, M. 2001. Local control for mesh morphing. In Shape Modeling International, 209–215. Google ScholarDigital Library
2. BESL, P. J., AND JAIN, R. C. 1985. Three-dimensional object recognition. Computing Surveys 17, 1 (March), 75–145. Google ScholarDigital Library
3. BESL, P., AND MCKAY, N. 1992. A method for registration of 3D shapes. IEEE Transactions on Pattern Analysis and Machine Intelligence 14, 2, 239–256. Google ScholarDigital Library
4. CHEN, D.-Y., OUHYOUNG, M., TIAN, X.-P., AND SHEN, Y.-T. 2003. On visual similarity based 3D model retrieval. Computer Graphics Forum, 223–232.Google Scholar
5. COHEN, M., 2000. Everything by example. Keynote talk at Chinagraphics 2000.Google Scholar
6. CORNEY, J., REA, H., CLARK, D., PRITCHARD, J., BREAKS, M., AND MACLEOD, R. 2002. Coarse filters for shape matching. IEEE Computer Graphics & Applications 22, 3 (May/June), 65–74. Google ScholarDigital Library
7. CURTIS, G. 2003. Disarmed: The Story of the Venus de Milo. Alfred A. Knopf.Google Scholar
8. ELAD, M., TAL, A., AND AR, S. 2001. Content based retrieval of VRML objects – an iterative and interactive approach. In 6th Eurographics Workshop on Multimedia 2001. Google ScholarDigital Library
9. FUNKHOUSER, T., MIN, P., KAZHDAN, M., CHEN, J., HALDERMAN, A., DOBKIN, D., AND JACOBS, D. 2003. A search engine for 3D models. Transactions on Graphics 22, 1, 83–105. Google ScholarDigital Library
10. GREGORY, A., STATE, A., LIN, M., MANOCHA, D., AND LIVINGSTON, M. 1999. Interactive surface decomposition for polyhedral morphing. Visual Comp 15, 453–470.Google ScholarDigital Library
11. HORN, B., HILDEN, H., AND NEGAHDARIPOUR, S. 1988. Closed form solutions of absolute orientation using orthonormal matrices. Journal of the Optical Society 5, 1127–1135.Google ScholarCross Ref
12. HORN, B. 1987. Closed form solutions of absolute orientation using unit quaternions. Journal of the Optical Society 4, 629–642.Google ScholarCross Ref
13. IGARASHI, T., MATSUOKA, S., AND TANAKA, H. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of SIGGRAPH 1999, Computer Graphics Proceedings, Annual Conference Series, ACM, 409–416. Google ScholarDigital Library
14. KANAI, T., SUZUKI, H., MITANI, J., AND KIMURA, F. 1999. Interactive mesh fusion based on local 3D metamorphosis. In Graphics Interface, 148–156. Google ScholarDigital Library
15. KATZ, S., AND TAL, A. 2003. Hierarchical mesh decomposition using fuzzy clustering and cuts. ACM Transactions on Graphics (TOG) 22, 3, 954–961. Google ScholarDigital Library
16. KAZHDAN, M. 2004. Shape Representations and Algorithms for 3D Model Retrieval. PhD thesis, Department of Computer Science, Princeton University. Google ScholarDigital Library
17. KOSTELEC, P., AND ROCKMORE, D. 2003. FFTs on the rotation group. Tech. Rep. 03-11-060, Santa Fe Institute’s Working Paper Series.Google Scholar
18. LAZARUS, F., AND VERROUST, A. 1998. 3D metamorphosis: a survey. The Visual Computer 14, 8–9.Google ScholarCross Ref
19. LEE, Y., AND LEE, S. 2002. Geometric snakes for triangular meshes. Computer Graphics Forum (Eurographics 2002) 21, 3, 229–238.Google Scholar
20. LEE, J., CHAI, J., REITSMA, P., HODGINS, J., AND POLLARD, N. 2002. Interactive control of avatars animated with human motion data. Proceedings of SIGGRAPH 2002, 491–500. Google ScholarDigital Library
21. LONCARIC, S. 1998. A survey of shape analysis techniques. Pattern Recognition 31, 8, 983–1001.Google ScholarCross Ref
22. MIN, P., HALDERMAN, J., KAZHDAN, M., AND FUNKHOUSER, T. 2003. Early experiences with a 3D model search engine. In Proceeding of the eighth international conference on 3D web technology, 7–18. Google ScholarDigital Library
23. MIN, P. 2004. A 3D Model Search Engine. PhD thesis, Department of Computer Science, Princeton University.Google Scholar
24. MITCHELL, J., 2003. personal communication.Google Scholar
25. MUSETH, K., BREEN, D., WHITAKER, R., AND BARR, A. 2002. Level set surface editing operators. Proceedings of SIGGRAPH 2002, 330–338. Google ScholarDigital Library
26. OWADA, S., NIELSEN, F., NAKAZAWA, K., AND IGARASHI, T. 2003. A sketching interface for modeling the internal structures of 3D shapes. In 3rd International Symposium on Smart Graphics, Lecture Notes in Computer Science, Springer, 49–57. Google ScholarDigital Library
27. PAQUET, E., AND RIOUX, M. 1997. Nefertiti: A query by content software for three-dimensional models databases management. In International Conference on Recent Advances in 3-D Digital Imaging and Modeling. Google ScholarDigital Library
28. RUBNER, Y., TOMASI, C., AND GUIBAS, L. J. 2000. The earth mover’s distance as a metric for image retrieval. vol. 40, 99–121. Google ScholarDigital Library
29. SHILANE, P., MIN, P., KAZHDAN, M., AND FUNKHOUSER, T. 2004. The princeton shape benchmark. In Shape Modeling International.Google Scholar
30. SLOAN, P., ROSE, C., AND COHEN, M. 2001. Shape by example. Symposium on Interactive 3D Graphics (March), 135–143. Google ScholarDigital Library
31. SOFT 1.0, 2003. www.cs.dartmouth.edu/ ~geelong/soft/.Google Scholar
32. SUZUKI, M. T. 2001. A web-based retrieval system for 3D polygonal models. Joint 9th IFSA World Congress and 20th NAFIPS International Conference (IFSA/NAFIPS2001) (July), 2271–2276.Google ScholarCross Ref
33. TANGELDER, J., AND VELTKAMP, R. 2003. Polyhedral model retrieval using weighted point sets. In Shape Modeling International. Google ScholarDigital Library
34. TANGELDER, J., AND VELTKAMP, R. 2004. A survey of content based 3D shape retrieval methods. In Shape Modeling International.Google Scholar
35. VRANIC, D. V. 2003. An improvement of rotation invariant 3D shape descriptor based on functions on concentric spheres. In IEEE International Conference on Image Processing (ICIP 2003), vol. 3, 757–760.Google Scholar
36. WAVEFRONT, A., 2003. Maya. http://www.aliaswavefront.com.Google Scholar
37. WONG, K. C.-H., SIU, Y.-H. S., HENG, P.-A., AND SUN, H. 1998. Interactive volume cutting. In Graphics Interface.Google Scholar
38. ZELEZNIK, R., HERNDON, K., AND HUGHES, J. 1996. Sketch: An interface for sketching 3D scenes. In Proceedings of SIGGRAPH 96, Computer Graphics Proceedings, Annual Conference Series, 163–170. Google ScholarDigital Library
39. ZÖCKLER, M., STALLING, D., AND HEGE, H. 2000. Fast and intuitive generation of geometric shape transitions. Visual Comp 16, 5, 241–253.Google ScholarCross Ref