“Volumetric illustration: designing 3D models with internal textures” by Owada, Nielsen, Okabe and Igarashi

This paper presents an interactive system for designing and browsing volumetric illustrations. Volumetric illustrations are 3D models with internal textures that the user can browse by cutting the models at desired locations. To assign internal textures to a surface mesh, the designer cuts the mesh and provides simple guiding information to specify the correspondence between the cross-section and a reference 2D image. The guiding information is stored with the geometry and used during the synthesis of cross-sectional textures. The key idea is to synthesize a plausible cross-sectional image using a 2D texture-synthesis technique, instead of sampling from a complete 3D RGB volumetric representation directly. This simplifies the design interface and reduces the amount of data, making it possible for non-experts to rapidly design and use volumetric illustrations. We believe that our system can enrich human communications in various domains, such as medicine, biology, and geology.

1. ASHIKHMIN, M. 2001. Synthesizing Natural Textures. In Proceedings of the Symposium on Interactive 3D Graphics 2001, 217–226. Google ScholarDigital Library
2. BANVARD, R. A. 2002. The Visible Human Project® Image Data Set From Inception to Completion and Beyond, In Proceedings CODATA 2002: Frontiers of Scientific and Technical Data, Track I-D-2: Medical and Health Data, Montréal, Canada, October, 2002.Google Scholar
3. COHEN, M. F., SHADE, J., HILLER, S., AND DEUSSEN, O. 2003. Wang Tiles for Image and Texture Generation. ACM Transactions on Graphics (Proc. Siggraph 2003), 287–294. Google ScholarDigital Library
4. CUTLER, B., DORSEY, J., MCMILLAN, L., MULLER, M., AND JAGNOW, R. 2002, A Procedural Approach to Authoring Solid Models. ACM Transactions on Graphics (Proc. Siggraph 2002), 302–311 Google ScholarDigital Library
5. EFROS, A. A., AND FREEMAN, W. T. 2001. Image Quilting for Texture Synthesis and Transfer. In Proceedings of Siggraph 2001, 341–346. Google ScholarDigital Library
6. EFROS, A. A., AND LEUNG, T. 1999. Texture Synthesis by Non-parametric Sampling. In Proceedings of International Conference on Computer Vision (ICCV ’99), 1033–1038. Google ScholarDigital Library
7. FERLEY, E., CANI, M. P., AND GASUEL, J. D. 2000. Practical Volumetric Sculpting. The Visual Computer, 16(8), (2000) 469–480.Google Scholar
8. GALYEAN, T. A., AND HUGHES, J. F. 1991. Sculpting: An Interactive Volumetric Modeling Technique. In Proceedings of Siggraph 1991, 109–116. Google ScholarDigital Library
9. GOOCH, B., AND GOOCH, A. 2001. Non-Photorealistic Rendering. A. K. Peters. Google ScholarDigital Library
10. HANRAHAN, P., AND HAEBERLI, P. 1990. Direct WYSIWYG Painting and Texturing on 3D Shapes. In Proceedings of Siggraph 1990, 215–223. Google ScholarDigital Library
11. HEEGER, D. J., AND BERGEN, J. R. 1995. Pyramid-based texture analysis and synthesis. In Proceedings of Siggraph 1995, 229–238. Google ScholarDigital Library
12. HERTZMANN, A., JACOBS, C. E., OLIVER, N., CURLESS, B., AND SALESIN, D. H. 2001. Image Analogies. In Proceedings of Siggraph 2001, 327–340. Google ScholarDigital Library
13. HINCKLEY, K., PAUSCH, R., GOBLE, J., AND KASSELL, N. 1994. Passive Real-World Interface Props for Neurosurgical Visualization. In Proceedings of CHI ’94, 452–458. Google ScholarDigital Library
14. HOFFMAN, C. K. 1989. Geometric and Solid Modeling. Morgan Kaufmann Pub. Google ScholarDigital Library
15. IGARASHI, T., MATSUOKA, S., AND TANAKA, H. 1999. Teddy: A Sketching Interface for 3D Freeform Design. In Proceedings of Siggraph 1999, 409–416. Google ScholarDigital Library
16. KALNINS, R. D., MARKOSIAN, L., MEIER, B. J., KOWALSKI, M. A., LEE, J. C., DAVIDSON, P. L., WEBB, M., HUGHES, J. F., AND FINKELSTEIN, A. 2002. WYSIWYG NPR: drawing strokes directly on 3D models. ACM Transactions on Graphics (Proc. Siggraph 2002), 755–762. Google ScholarDigital Library
17. KNISS, J., PREMOŽE, S., HANSEN, C., AND EBERT, D. 2002. Interactive Translucent Volume Rendering and Procedural Modeling. In Proceedings of Visualization 2002, IEEE Computer Society, 109–116. Google ScholarDigital Library
18. KWATRA, V., SCHÖDL, A., ESSA, I., TURK, G., AND BOBICK, A. 2002. Graphcut Textures: Image and Video Synthesis Using Graph Cuts. ACM Transactions on Graphics (Proc. Siggraph 2003), 277–286. Google ScholarDigital Library
19. LAKE, A., MARSHALL, C., HARRIS, M., AND BLACKSTEIN, M. 2000. Stylized Rendering Techniques for Scalable Real-Time 3D Animation. In Proceedings of NPAR, 13–20. Google ScholarDigital Library
20. MCGUFFIN, M. J., TANCAU, L., AND BALAKRISHNAN, R. 2003. Using Deformations for Browsing Volumetric Data. In Proceedings of Visualization 2003, 401–408. Google ScholarDigital Library
21. OWADA, S., NIELSEN, F., NAKAZAWA, K., AND IGARASHI, T. 2003. A Sketching Interface for Modeling the Internal Structures of 3D Shapes. Lecture Notes in Computer Science (LNCS 2733; Smart Graphics 2003), Springer-Verlag, 49–57Google Scholar
22. PEDERSON, H. K. 1996. A Framework for Interactive Texturing on Curved Surfaces. In Proceedings of Siggraph 1996, 295–302. Google ScholarDigital Library
23. PERLIN, K. 1985. An Image Synthesizer. In Proceedings of Siggraph 1985, 287–296. Google ScholarDigital Library
24. PRAUN, E., FINKELSTEIN, A., AND HOPPE, H. 2000. Lapped Textures. In Proceedings of Siggraph 2000, 465–470. Google ScholarDigital Library
25. STAM, J. 1997. Aperiodic Texture Mapping. Technical Report R046, European Research Consortium for Informatics and Mathematics (ERCIM).Google Scholar
26. TURK, G., AND O’BRIEN, J. F. 1999. Variational Implicit Surfaces. Technical Report GIT-GVU-99-15, Graphics, Visualization, and Usability Center. Georgia Institute of Technology.Google Scholar
27. TURK, G. 2001. Texture Synthesis on Surfaces. In Proceedings of Siggraph 2001, 347–354. Google ScholarDigital Library
28. VIEGA, J., CONWAY, M. J., WILLIAMS, G., AND PAUSCH, R. 2002. 3D Magic Lenses. In Proceedings of UIST ’96, 51–58. Google ScholarDigital Library
29. WANG, S. W., AND KAUFMAN, A. E. 1995. Volume Sculpting. In Proceedings of Symposium on Interactive 3D Graphics 1995, 151–156 Google ScholarDigital Library
30. WEI, L-Y., AND LEVOY, M. 2000. Fast Texture Synthesis using Tree-structured Vector Quantization. In Proceedings of Siggraph 2000, 479–488. Google ScholarDigital Library
31. WEI, L-Y. 2001. Texture Synthesis by Fixed Neighborhood Searching. Ph.D. Thesis. Stanford University. Google ScholarDigital Library
32. ZHANG, J., ZHOU, K., VELHO, L., GUO, B., AND SHUM, H-Y. 2003. Synthesis of Progressively-Variant Textures on Arbitrary Surfaces. ACM Transactions on Graphics (Proc. Siggraph 2003), 295–302. Google ScholarDigital Library