“Scanning physical interaction behavior of 3D objects” by Pai, van den Doel, James, Lang, Lloyd, et al. …

We describe a system for constructing computer models of several aspects of physical interaction behavior, by scanning the response of real objects. The behaviors we can successfully scan and model include deformation response, contact textures for interaction with force-feedback, and contact sounds. The system we describe uses a highly automated robotic facility that can scan behavior models of whole objects. We provide a comprehensive view of the modeling process, including selection of model structure, measurement, estimation, and rendering at interactive rates. The results are demonstrated with two examples: a soft stuffed toy which has significant deformation behavior, and a hard clay pot which has significant contact textures and sounds. The results described here make it possible to quickly construct physical interaction models of objects for applications in games, animation, and e-commerce.

1. M.J. Black and P. Anandan. The Robust Estimation of Multiple Motions: Parametric and Piecewise-smooth Flow Fields. Computer Vision and Image Understanding, 63(1):75-104, 1996.
2. Y. Bouguet and P. Perona. 3D Photography on Your Desk. In Proc. ICCV98, pages 43-50, 1998.
3. J.C. Brown and M.S. Puckette. A High Resolution Fundamental Frequency Determination Based on Phase Changes of the Fourier Transform. J. Acoust. Soc. Am., 94(2):662-667, 1993.
4. M. Cohen, M. Levoy, J. Malik, L. McMillan, and E. Chen. Image-based Rendering: Really New or Deja Vu? ACM SIGGRAPH 97 Panel, pages 468 – 470.
5. P.R. Cook. Integration of Physical Modeling for Synthesis and Animation. In Proceedings of the International Computer Music Conference, pages 525-528, Banff, 1995.
6. P.R. Cook and D. Trueman. NBody: Interactive Multidirectional Musical Instrument Body Radiation Simulations, and a Database of Measured Impulse Responses. In Proceedings of the International Computer Music Conference, San Francisco, 1998.
7. S. Cotin, H. Delingette, J-M Clement, V. Tassetti, J. Marescaux, and N. Ayache. Geometric and Physical Representations for a Simulator of Hepatic Surgery. In Proceedings of Medicine Meets Virtual Real ity IV, pages 139-151. IOS Press, 1996.
8. B. Curless and M. Levoy. A Volumetric Method for Building Complex Models from Range Images. In SIG- GRAPH 96 Conference Proceedings, pages 303-312, 1996.
9. K.J. Dana, B. van Ginneken, S.K. Nayar, and J.J. Koenderink. Re ectance and Texture of Real-world Surfaces. ACM Transactions on Graphics, 18(1):1-34, 1999.
10. P. Debevec, T. Hawkins, C. Tchou, H-P Duiker, W. Sarokin, and M. Sagar. Acquiring the Re ectance Field of a Human Face. In SIGGRAPH 2000 Conference Proceedings, pages 145-156, 2000.
11. P.E. Debevec, C.J. Taylor, and J. Malik. Modeling and Rendering Architecture from Photographs: A Hybrid Geometry- and Image-Based Approach. In SIGGRAPH 96 Conference Proceedings, pages 11-20, 1996.
12. T.A. Funkhouser, I. Carlbom, G. Pingali G. Elko, M. Sondhi, and J. West. Interactive Acoustic Modeling of Complex Environments. J. Acoust. Soc. Am., 105(2), 1999.
13. M. Garland and P.S. Heckbert. Surface Simplification Using Quadric Error Metrics. In SIGGRAPH 97 Conference Proceedings, pages 209-216, 1997.
14. W.W. Gaver. Synthesizing Auditory Icons. In Proceedings of the ACM INTERCHI 1993, pages 228-235, 1993.
15. D.P. Greenberg, K.E. Torrance, P. Shirley, J. Arvo, J.A. Ferwerda, S. Pattanaik, E.P.F. Lafortune, B. Walter, S. Foo, and B. Trumbore. A Framework for Realistic Image Synthesis. In SIGGRAPH 97 Conference Proceedings, pages 477-494, 1997.
16. I. Guskov, K. Vidimce, W. Sweldens, and P. Schroder. Normal Meshes. In SIGGRAPH 2000 Conference Proceedings, pages 95-102, 2000.
17. H. Hoppe, T. DeRose, T. Duchamp, M. Halstead, H. Jin, J. McDonald, J. Schweitzer, and W. Stuetzle. Piecewise Smooth Surface Reconstruction. In SIGGRAPH 94 Conference Proceedings, pages 295-302, 1994.
18. D.L. James and D.K. Pai. ArtDefo, Accurate Real Time Deformable Objects. In SIGGRAPH 99 Conference Proceedings, pages 65-72, 1999.
19. D.L. James and D.K. Pai. A Unified Treatment of Elastostatic Contact Simulation for Real Time Haptics. Haptics-e, The Electronic Journal of Haptics Research (www.haptics-e.org), 2001. (To appear).
20. J. Lang and D. K. Pai. Estimation of Elastic Constants from 3D Range-Flow. In Proceedings of the Third International Conference on 3-D Digital Imaging and Modeling, 2001.
21. A. Lee, H. Moreton, and H. Hoppe. Displaced Subdivision Surfaces. In SIGGRAPH 2000 Conference Proceedings, pages 85-94, 2000.
22. A. Lee, W. Sweldens, P. Schroder, L. Cowsar, and D. Dobkin. MAPS: Multiresolution Adaptive Parameterization of Surfaces. In SIGGRAPH 98 Conference Proceedings, pages 95-104, 1998.
23. M. Levoy, et al. The Digital Michelangelo Project: 3D Scanning of Large Statues. In SIGGRAPH 2000 Conference Proceedings, pages 131-144, 2000.
24. D. K. Pai, J. Lang, J. E. Lloyd, and J. L. Richmond. Reality-based Modeling with ACME: A Progress Report. In Proceedings of the Intl . Symp. on Experimental Robotics, 2000.
25. D. K. Pai, J. Lang, J. E. Lloyd, and R. J. Woodham. ACME, A Telerobotic Active Measurement Facility. In Proceedings of the Sixth Intl . Symp. on Experimental Robotics, 1999.
26. Z. Popovic and A. Witkin. Physically Based Motion Transformation. In SIGGRAPH 99 Conference Proceedings, pages 11-20, 1999.
27. C. Rocchini, P. Cignoni, C.Montani, and P. Scopigno. Multiple Textures Stitching and Blending on 3D Objects. In 10th Eurographics Workshop on Rendering, pages 173-180, Granada, Spain, 1999.
28. G. Roth and E. Wibowoo. An Efficient Volumetric Method for Building Closed Triangular Meshes from 3- D Image and Point Data. In Proc. Graphics Interface, pages 173-180, 1997.
29. P.J. Rousseeuw. Least Median of Squares Regression. Journal of the American Statistical Association, 79(388):871-880, 1984.
30. P.J. Rousseeuw and K. Van Driessen. Computing LTS Regression for Large Data Sets. Technical report, University of Antwerp, 1999.
31. H. Rushmeier, F. Bernardini, J. Mittleman, and G. Taubin. Acquiring Input for Rendering at Appropriate Levels of Detail: Digitizing a Piet~ a. Eurographics Rendering Workshop 1998, pages 81-92, 1998.
32. D.C. Ruspini, K. Kolarov, and O. Khatib. The Haptic Display of Complex Graphical Environments. In SIGGRAPH 97 Conference Proceedings, pages 345-352, 1997.
33. Y. Sato, M.D. Wheeler, and K. Ikeuchi. Object Shape and Re ectance Modeling from Observation. In SIG- GRAPH 97 Conference Proceedings, pages 379-388, 1997.
34. H. Spies, B. Jahne, and J.L. Barron. Dense Range Flow from Depth and Intensity Data. In International Conference on Pattern Recognition, pages 131-134, 2000.
35. K. Steiglitz. A Digital Signal Processing Primer with Applications to Digital Audio and Computer Music. Addison-Wesley, New York, 1996.
36. K. Steiglitz and L.E. McBride. A Technique for the Identification of Linear System. IEEE Trans. Automatic Control, AC-10:461-464, 1965.
37. D. Terzopoulos, J. Platt, A. Barr, and K. Fleischer. Elastically Deformable Models. In Computer Graphics (SIGGRAPH 87 Proceedings), volume 21, pages 205- 214, 1987.
38. T.R. Thomas. Rough Surfaces. Imperial College Press, London, second edition, 1999.
39. K. van den Doel, P.G. Kry, and D.K. Pai. FoleyAutomatic: Physically-based Sound Effects for Interactive Simulations and Animations. In SIGGRAPH 2001 Conference Proceedings, 2001.
40. K. van den Doel and D.K. Pai. The Sounds of Physical Shapes. Presence, 7(4):382-395, 1998.
41. S. Vedula, S. Baker, P. Rander, R. Collins, and T. Kanade. Three-dimensional Scene Flow. In International Conference on Computer Vision, pages 722-729, 1999.
42. M. Yamamoto, P. Boulanger, J.-A. Beraldin, and M. Rioux. Direct Estimation of Range Flow on Deformable Shape from a Video Rate Range Camera. PAMI, 15(1):82-89, 1993.
43. Y. Zhang and C. Kambhamettu. Integrated 3D Scene Flow and Structure Recovery from Multiview Image Sequences. In Computer Vision and Pattern Recognition, volume 2, pages 674-681, 2000.