“Scale-aware black-and-white abstraction of 3D shapes” by Lin, Yang and Chu

  • ©You-En Lin, Yong-Liang Yang, and Hung-Kuo Chu



Entry Number: 117


    Scale-aware black-and-white abstraction of 3D shapes

Session/Category Title: Decision & Style R&E




    Flat design is a modern style of graphics design that minimizes the number of design attributes required to convey 3D shapes. This approach suits design contexts requiring simplicity and efficiency, such as mobile computing devices. This `less-is-more’ design inspiration has posed significant challenges in practice since it selects from a restricted range of design elements (e.g., color and resolution) to represent complex shapes. In this work, we investigate a means of computationally generating a specialized 2D flat representation – image formed by black-and-white patches – from 3D shapes. We present a novel framework that automatically abstracts 3D man-made shapes into 2D binary images at multiple scales. Based on a set of identified design principles related to the inference of geometry and structure, our framework jointly analyzes the input 3D shape and its counterpart 2D representation, followed by executing a carefully devised layout optimization algorithm. The robustness and effectiveness of our method are demonstrated by testing it on a wide variety of man-made shapes and comparing the results with baseline methods via a pilot user study. We further present two practical applications that are likely to benefit from our work.


    1. Rayan Abdullah and Roger Hüber. 2006. Pictograms, Icons & Signs: A Guide to Information Graphics. Thames and Hudson Ltd.Google Scholar
    2. Arthur Appel, F. James Rohlf, and Arthur J. Stein. 1979. The Haloed Line Effect for Hidden Line Elimination.. In Proceedings of the 6th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’79). 151–157. Google ScholarDigital Library
    3. Henk Bekker, Jos B.T.M. Roerdink, Tobias Isenberg, and Maarten H. Everts. 2009. Depth-Dependent Halos: Illustrative Rendering of Dense Line Data. IEEE Transactions on Visualization and Computer Graphics 15 (2009), 1299–1306. Google ScholarDigital Library
    4. Gilbert Louis Bernstein and Wilmot Li. 2015. Lillicon: Using Transient Widgets to Create Scale Variations of Icons. ACM Trans. Graph. 34, 4 (2015), 144:1–144:11. Google ScholarDigital Library
    5. Stefan Bruckner and Eduard Gröller. 2007. Enhancing Depth-Perception with Flexible Volumetric Halos. IEEE Transactions on Visualization and Computer Graphics 13, 6 (2007), 1344–1351. Google ScholarDigital Library
    6. Ding-Yun Chen, Xiao-Pei Tian, Yu-Te Shen, and Ming Ouhyoung. 2003. On Visual Similarity Based 3D Model Retrieval. Computer Graphics Forum 22, 3 (2003), 223–232.Google ScholarCross Ref
    7. Forrester Cole, Aleksey Golovinskiy, Alex Limpaecher, Heather Stoddart Barros, Adam Finkelstein, Thomas Funkhouser, and Szymon Rusinkiewicz. 2008. Where Do People Draw Lines? ACM Trans. Graph. 27, 3 (2008), 88:1–88:11. Google ScholarDigital Library
    8. Doug DeCarlo, Adam Finkelstein, Szymon Rusinkiewicz, and Anthony Santella. 2003. Suggestive Contours for Conveying Shape. ACM Trans. Graph. 22, 3 (2003), 848–855. Google ScholarDigital Library
    9. Elmar Eisemann, Sylvain Paris, and Frédo Durand. 2009. A Visibility Algorithm for Converting 3D Meshes into Editable 2D Vector Graphics. ACM Trans. Graph. 28, 3 (2009), 83:1–83:8. Google ScholarDigital Library
    10. Gershon Elber. 1995. Line illustrations is computer graphics. The Visual Computer 11, 6 (1995), 290–296.Google ScholarCross Ref
    11. Ran Gal, Olga Sorkine, Niloy J. Mitra, and Daniel Cohen-Or. 2009. iWIRES: An Analyze-and-edit Approach to Shape Manipulation. ACM Trans. Graph. 28, 3 (2009), 33:1–33:10. Google ScholarDigital Library
    12. Aaron Hertzmann and Denis Zorin. 2000. Illustrating Smooth Surfaces. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH ’00). 517–526. Google ScholarDigital Library
    13. Tilke Judd, Frédo Durand, and Edward Adelson. 2007. Apparent Ridges for Line Drawing. ACM Trans. Graph. 26, 3 (2007). Google ScholarDigital Library
    14. Alexander Kolliopoulos, Jack M. Wang, and Aaron Hertzmann. 2006. Segmentation-based 3D Artistic Rendering. In Proceedings of the 17th Eurographics Conference on Rendering Techniques (EGSR ’06). 361–370. Google ScholarDigital Library
    15. Hua Li and David Mould. 2015. Contrast-Enhanced Black and White Images. Comput. Graph. Forum 34, 7 (2015), 319–328. Google ScholarDigital Library
    16. Yiming Liu, Aseem Agarwala, Jingwan Lu, and Szymon Rusinkiewicz. 2016. Data-driven Iconification. In Proceedings of the Joint Symposium on Computational Aesthetics and Sketch Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering (Expresive ’16). 113–124. Google ScholarDigital Library
    17. Thomas Luft, Carsten Colditz, and Oliver Deussen. 2006. Image Enhancement by Unsharp Masking the Depth Buffer. ACM Trans. Graph. 25, 3 (2006), 1206–1213. Google ScholarDigital Library
    18. Ravish Mehra, Qingnan Zhou, Jeremy Long, Alla Sheffer, Amy Gooch, and Niloy J. Mitra. 2009. Abstraction of Man-made Shapes. ACM Trans. Graph. 28, 5 (2009), 137:1–137:10. Google ScholarDigital Library
    19. Tom Page. 2014. Skeuomorphism or Flat Design: Future Directions in Mobile Device User Interface UI Design Education. Int. J. Mob. Learn. Organ. 8, 2 (2014), 130–142. Google ScholarDigital Library
    20. Paul L. Rosin and Yu-Kun Lai. 2010. Towards Artistic Minimal Rendering. In Proceedings of the 8th International Symposium on Non-Photorealistic Animation and Rendering (NPAR ’10). 119–127. Google ScholarDigital Library
    21. Szymon Rusinkiewicz, Forrester Cole, Doug DeCarlo, and Adam Finkelstein. 2008. Line Drawings from 3D Models. In ACM SIGGRAPH 2008 Classes (SIGGRAPH ’08). 39:1–39:356. Google ScholarDigital Library
    22. Peter Selinger. 2003. Potrace: a polygon-based tracing algorithm. In In http://potrace.sourceforge.net.Google Scholar
    23. Ariel Shamir. 2008. A survey on Mesh Segmentation Techniques. Computer Graphics Forum 27, 6 (2008), 1539–1556.Google ScholarCross Ref
    24. Jie Xu and Craig S. Kaplan. 2008. Artistic Thresholding. In Proceedings of the 6th International Symposium on Non-photorealistic Animation and Rendering (NPAR ’08). 39–47. Google ScholarDigital Library
    25. Yong-Liang Yang, Jun Wang, and Niloy J. Mitra. 2015. Reforming Shapes for Material-aware Fabrication. Comput. Graph. Forum 34, 5 (2015), 53–64.Google ScholarDigital Library
    26. Jonathan S. Yedidia, William T. Freeman, and Yair Weiss. 2003. Exploring Artificial Intelligence in the New Millennium. Chapter Understanding Belief Propagation and Its Generalizations, 239–269. Google ScholarDigital Library
    27. Mehmet Ersin Yumer and Levent Burak Kara. 2012. Co-abstraction of Shape Collections. ACM Trans. Graph. 31, 6 (2012), 166:1–166:11. Google ScholarDigital Library

ACM Digital Library Publication:

Overview Page: