“Closure-aware sketch simplification” by Liu, Wong and Heng
Conference:
Type(s):
Title:
- Closure-aware sketch simplification
Session/Category Title:
- Color and Sketching
Presenter(s)/Author(s):
Abstract:
In this paper, we propose a novel approach to simplify sketch drawings. The core problem is how to group sketchy strokes meaningfully, and this depends on how humans understand the sketches. The existing methods mainly rely on thresholding low-level geometric properties among the strokes, such as proximity, continuity and parallelism. However, it is not uncommon to have strokes with equal geometric properties but different semantics. The lack of semantic analysis will lead to the inability in differentiating the above semantically different scenarios. In this paper, we point out that, due to the gestalt phenomenon of closure, the grouping of strokes is actually highly influenced by the interpretation of regions. On the other hand, the interpretation of regions is also influenced by the interpretation of strokes since regions are formed and depicted by strokes. This is actually a chicken-or-the-egg dilemma and we solve it by an iterative cyclic refinement approach. Once the formed stroke groups are stabilized, we can simplify the sketchy strokes by replacing each stroke group with a smooth curve. We evaluate our method on a wide range of different sketch styles and semantically meaningful simplification results can be obtained in all test cases.
References:
1. Bae, S., Balakrishnan, R., and Singh, K. 2008. Ilovesketch: as-natural-as-possible sketching system for creating 3d curve models. In Proceedings of the 21st Annual ACM Symposium on User Interface Software and Technology, Monterey, CA, USA, October 19-22, 2008, 151–160.
2. Barla, P., Thollot, J., and Sillion, F. X. 2005. Geometric clustering for line drawing simplification. In Proceedings of the Eurographics Symposium on Rendering Techniques, 183–192.
3. Barla, P., Thollot, J., and Sillion, F. X. 2005. Geometric clustering for line drawing simplification. In ACM SIGGRAPH 2005 Sketches, ACM, 96.
4. Baudel, T. 1994. A mark-based interaction paradigm for free-hand drawing. In ACM Symposium on User Interface Software and Technology, 185–192.
5. Chen, J., Guennebaud, G., Barla, P., and Granier, X. 2013. Non-oriented MLS gradient fields. Comput. Graph. Forum 32, 8, 98–109.
6. Chien, Y., Lin, W.-C., Huang, T.-S., and Chuang, J.-H. 2014. Line drawing simplification by stroke translation and combination. In The 5th International Conference on Graphic and Image Processing, 90690X–90690X.
7. Deussen, O., and Strothotte, T. 2000. Computer-generated pen-and-ink illustration of trees. In SIGGRAPH, 13–18.
8. Dimiccoli, M., and Salembier, P. 2009. Exploiting t-junctions for depth segregation in single images. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing, ICASSP 2009, 19–24 April 2009, Taipei, Taiwan, 1229–1232.
9. Dimiccoli, M., and Salembier, P. 2009. Hierarchical region-based representation for segmentation and filtering with depth in single images. In Proceedings of the International Conference on Image Processing, ICIP 2009, 7-10 November 2009, Cairo, Egypt, 3533–3536.
10. Fu, H., Zhou, S., Liu, L., and Mitra, N. J. 2011. Animated construction of line drawings. ACM Trans. Graph. 30, 6, 133.
11. Grabli, S., Durand, F., and Sillion, F. X. 2004. Density measure for line-drawing simplification. In The 12th Pacific Conference on Computer Graphics and Applications (PG 2004), 309–318.
12. Grimm, C., and Joshi, P. 2012. Just drawit: A 3d sketching system. In Proceedings of the International Symposium on Sketch-Based Interfaces and Modeling, SBIM ’12, 121–130.
13. Kara, L. B., D’Eramo, C. M., and Shimada, K. 2006. Pen-based styling design of 3d geometry using concept sketches and template models. In Proceedings of the 10th ACM Symposium on Solid and Physical Modeling, 149–160.
14. Lindlbauer, D., Haller, M., Hancock, M. S., Scott, S. D., and Stuerzlinger, W. 2013. Perceptual grouping: selection assistance for digital sketching. In The ACM International Conference on Interactive Tabletops and Surfaces, ITS ’13, St Andrews, United Kingdom – October 06-09, 2013, 51–60.
15. Liu, X., Mao, X., Yang, X., Zhang, L., and Wong, T.-T. 2013. Stereoscopizing cel animations. ACM Trans. Graph. 32, 6, 223.
16. Liu, J., Fu, H., and Tai, C. 2014. Dynamic sketching: simulating the process of observational drawing. In Proceedings of the Workshop on Computational Aesthetics, CAe ’14, Vancouver, British Columbia, Canada, August 8-10, 2014, 15–22.
17. Nan, L., Sharf, A., Xie, K., Wong, T.-T., Deussen, O., Cohen-Or, D., and Chen, B. 2011. Conjoining gestalt rules for abstraction of architectural drawings. ACM Trans. Graph. 30, 6, 185.
18. Noris, G., Sýkora, D., Shamir, A., Coros, S., Whited, B., Simmons, M., Hornung, A., Gross, M. H., and Sumner, R. W. 2012. Smart scribbles for sketch segmentation. Comput. Graph. Forum 31, 8, 2516–2527.
19. Noris, G., Hornung, A., Sumner, R. W., Simmons, M., and Gross, M. H. 2013. Topology-driven vectorization of clean line drawings. ACM Trans. Graph. 32, 1, 4.
20. Orbay, G., and Kara, L. B. 2011. Beautification of design sketches using trainable stroke clustering and curve fitting. IEEE Trans. Vis. Comput. Graph. 17, 5, 694–708.
21. Pavlidis, T., and Wyk, C. J. V. 1985. An automatic beautifier for drawings and illustrations. In Proceedings of the 12th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH 1985), 225–234.
22. Preim, B., and Strothotte, T. 1995. Tuning rendered line-drawings. In Proceedings of the 3rd Central European Conference on Computer Graphics, 227–237.
23. Pusch, R., Samavati, F. F., Nasri, A. H., and Wyvill, B. 2007. Improving the sketch-based interface. The Visual Computer 23, 9–11, 955–962.
24. Qu, Y., Wong, T.-T., and Heng, P.-A. 2006. Manga colorization. ACM Trans. Graph. 25, 3, 1214–1220.
25. Rosin, P. L. 1994. Grouping curved lines. In Proceedings of the British Machine Vision Conference (BMVC 1994), 1–10.
26. Saund, E., and Moran, T. P. 1994. A perceptually-supported sketch editor. In ACM Symposium on User Interface Software and Technology, 175–184.
27. Shesh, A., and Chen, B. 2008. Efficient and dynamic simplification of line drawings. Comput. Graph. Forum 27, 2, 537–545.
28. Sýkora, D., Dingliana, J., and Collins, S. 2009. Lazybrush: Flexible painting tool for hand-drawn cartoons. Comput. Graph. Forum 28, 2, 599–608.
29. Wertheimer, M. 1923. Untersuchungen zur lehre von der gestalt. ii. Psychological Research 4, 1, 301–350.
30. Wilson, B., and Ma, K.-L. 2004. Rendering complexity in computer-generated pen-and-ink illustrations. In Proceedings of the 3rd International Symposium on Non-Photorealistic Animation and Rendering, 129–137.
31. Zhang, S.-H., Chen, T., Zhang, Y.-F., Hu, S.-M., and Martin, R. R. 2009. Vectorizing cartoon animations. IEEE Trans. Vis. Comput. Graph. 15, 4, 618–629.
