“Dataflow VFX Programming and Processing for Artists and OpenISS” by Mokhov, Song, Mudur and Grogono

We explore the notion of dataflow programming in realtime graphics artistic practice. We complement the previous editions of the course at SIGGRAPH Asia (2015, 2016, 2018) and SIGGRAPH (2017, 2019) to include OpenISS and PureData/GEM. First, we explore a rapid prototyping of interactive graphical applications for stage and beyond using Jitter/Max and Processing with OpenGL, shaders, and featuring connectivity with RGBD cameras. Such rapid prototyping environment is ideal for entertainment computing, as well as for artists and live performances using real-time interactive graphics on stage. We share the expertise we developed in connecting the real-time graphics with on-stage performance with the Illimitable Space System (ISS) v2 and its OpenISS core framework for creative near-realtime broadcasting, and the use of AI and HCI techniques in art.