“Cangjie’s Poetry: An Interactive Art Experience of A Semantic Human-Machine Reality” by Zhang, Ren and Legrady

  • ©Weidi Zhang, Donghao Ren, and George Legrady




    Cangjie's Poetry: An Interactive Art Experience of A Semantic Human-Machine Reality



    This paper describes the conceptual background, artificial intelligent system design, and visualization strategies of an interactive art experience: Cangjie’s Poetry. This artwork provides a conceptual response to the human-machine reality in the context of language, symbols, and semantic meanings. In the Cangjie’s Poetry art installation, the intelligent system (Cangjie) constantly observes surroundings through the lens of a camera, writes poetry using its symbolic system based on its interpretation, and explains the evolving poem in natural language to audiences in real time. Due to the global pandemic of COVID-19, multiple presentation formats of this work were developed, which include in-person installation, virtual installation, and a special edition with pre-rendered video. This work prioritizes ambiguity and tension between machinic vision and human perception, the actual and the virtual, past and present.


    1. Cangjie: Chinese God of Writing, Literature, Chinese Characters. 2013. Ancient Chinese Mythology. Retrieved from http://ancientchinesemythology.blogspot.com/2013/08/cangjie-chinese-god-of-writing.html

    2. Chris Cheung. 2020. 封筆-墨池記 I No Longer Write—Mochiji. Vimeo, uploaded by Chris Cheung, April 2020. www.vimeo.com/406793526

    3. Kwo Da-Wei. 2012. Chinese Brushwork in Calligraphy and Painting: Its History, Aesthetics, and Techniques. Courier Corporation, 2012.

    4. Willem de Kooning. 1948. Painting. MoMA collection. www.moma.org/collection/works/79242

    5. Jeff Donahue, Philipp Krähenbühl, and Trevor Darrell. 2016. Adversarial feature learning. arXiv preprint. Retrieved from https://arxiv.org/abs/1605.09782

    6. Encyclopedia Britannica (Eds.) 2019. Concrete poetry. Encyclopedia Britannica. https://www.britannica.com/art/concrete-poetry

    7. Sarah E. Fraser and Yu-Chieh Li (Eds.). 2020. Xu Bing: Beyond the Book from the Sky. Springer Nature.

    8. Justin Johnson, Andrej Karpathy, and Li Fei-Fei. 2016. DenseCap: fully convolutional localization networks for dense captioning. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2016, 4565–4574.

    9. Wikipedia. 2021. Cangjie (2021, June 12). Retrieved from Wikipedia: the Free Encyclopedia. https://en.wikipedia.org/wiki/Cangjie

ACM Digital Library Publication:

Overview Page:

Art Paper/Presentation Type: