“reconFIGURE: Confronting Audiences with Digital Doppelgängers” by Bruggisser, Leisi, Lund-Jensen, Fröhlich and Salter
Conference:
Type(s):
Title:
- reconFIGURE: Confronting Audiences with Digital Doppelgängers
Session/Category Title: Body & Bodies
Presenter(s)/Author(s):
Abstract:
This paper describes the artistic context, technical implementation, user study, evaluation and future work around reconFIGURE, a participatory installation exploring the transformation of human bodies through computational systems. The installation involves capturing visitors’ images, transforming these into animated 3D doppelg?ngers, and projecting them on a large-screen. Unique in its rapid transformation from 2D to 3D, reconFIGURE highlights the aesthetic-social repercussions of transforming whole human body images using machine learning.
References:
[1]
Valentin Bazarevsky, Ivan Grishchenko, Karthik Raveendran, Tyler Zhu, Fan Zhang, and Matthias Grundmann. 2020. BlazePose: On-device Real-time Body Pose tracking. https://doi.org/10.48550/ARXIV.2006.10204
Crossref
Google Scholar
[2]
Vasileios Choutas, Lea M?ller, Chun-Hao P. Huang, Siyu Tang, Dimitrios Tzionas, and Michael J. Black. 2022. Accurate 3D Body Shape Regression using Metric and Semantic Attributes. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR).
Google Scholar
[3]
Mark Coeckelbergh. 2020. AI ethics. Mit Press.
Google Scholar
[4]
Chlo? Desaulles, Alexandre Devaux, Or Fleisher, and Mark McKeague. 2022. Modeling key world cup moments with machine learning. https://rd.nytimes.com/projects/modeling-key-world-cup-moments-with-machine-learning
Google Scholar
[5]
Marc Downie and Paul Kaiser. 2019. Counterpart. http://openendedgroup.com/artworks/counterpart.html
Google Scholar
[6]
Sigmund Freud. 2017. The uncanny. In Romantic Writings. Routledge, 318–325.
Google Scholar
[7]
Anish Garg. 2020. Real-Time Person Segmentation — Based on Body Pix. International Journal for Modern Trends in Science and Technology 6 (12 2020), 1–7. https://doi.org/10.46501/IJMTST061201
Crossref
Google Scholar
[8]
Ian Goodfellow, Jean Pouget-Abadie, Mehdi Mirza, Bing Xu, David Warde-Farley, Sherjil Ozair, Aaron Courville, and Yoshua Bengio. 2014. Generative Adversarial Nets. In Advances in Neural Information Processing Systems, Z. Ghahramani, M. Welling, C. Cortes, N. Lawrence, and K.Q. Weinberger (Eds.), Vol. 27. Curran Associates, Inc.https://proceedings.neurips.cc/paper_files/paper/2014/file/5ca3e9b122f61f8f06494c97b1afccf3-Paper.pdf
Google Scholar
[9]
Mark BN Hansen. 2012. Bodies in code: Interfaces with digital media. Routledge.
Google Scholar
[10]
N Katherine Hayles. 2000. How we became posthuman: Virtual bodies in cybernetics, literature, and informatics.
Google Scholar
[11]
Jeonghwan Kim, Hyeontae Son, Jinseok Bae, and Young Min Kim. 2021. Auto-rigging 3D Bipedal Characters in Arbitrary Poses. In Eurographics 2021 – Short Papers, Holger Theisel and Michael Wimmer (Eds.). The Eurographics Association. https://doi.org/10.2312/egs.20211023
Crossref
Google Scholar
[12]
Naomi Klein. 2023. Doppelganger: A Trip into the Mirror World. Knopf Canada.
Google Scholar
[13]
Mario Klingeman. 2020. Circuit Training. https://underdestruction.com/2020/08/29/circuit-training/
Google Scholar
[14]
Myron Kruger. 1974. Videoplace. https://aboutmyronkrueger.weebly.com/videoplace.html
Google Scholar
[15]
Siu Kwan Lam, Antoine Pitrou, and Stanley Seibert. 2015. Numba: A LLVM-Based Python JIT Compiler. In Proceedings of the Second Workshop on the LLVM Compiler Infrastructure in HPC (Austin, Texas) (LLVM ’15). Association for Computing Machinery, New York, NY, USA, Article 52, 6 pages. https://doi.org/10.1145/2833157.2833162
Digital Library
Google Scholar
[16]
Zhong Li, Lele Chen, Celong Liu, Yu Gao, Yuanzhou Ha, Chenliang Xu, Shuxue Quan, and Yi Xu. 2019. 3D Human Avatar Digitization from a Single Image. In Proceedings of the 17th International Conference on Virtual-Reality Continuum and Its Applications in Industry (Brisbane, QLD, Australia) (VRCAI ’19). Association for Computing Machinery, New York, NY, USA, Article 52, 8 pages. https://doi.org/10.1145/3359997.3365707
Digital Library
Google Scholar
[17]
Zhong Li, Lele Chen, Celong Liu, Fuyao Zhang, Zekun Li, Yu Gao, Yuanzhou Ha, Chenliang Xu, Shuxue Quan, and Yi Xu. 2021. Animated 3D human avatars from a single image with GAN-based texture inference. Computers & Graphics 95 (2021), 81–91. https://doi.org/10.1016/j.cag.2021.01.002
Crossref
Google Scholar
[18]
Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2015. SMPL: A Skinned Multi-Person Linear Model. ACM Trans. Graph. 34, 6, Article 52 (nov 2015), 16 pages. https://doi.org/10.1145/2816795.2818013
Digital Library
Google Scholar
[19]
Kiona Hagen Niehaus and Rebecca Fiebrink. 2021. Making Up 3D Bodies: Artistic and Serendipitous Modeling of Digital Human Figures. Proc. ACM Comput. Graph. Interact. Tech. 4, 2, Article 52 (aug 2021), 9 pages. https://doi.org/10.1145/3468779
Digital Library
Google Scholar
[20]
Obvious. 2018. Edmond de Belamy. https://obvious-art.com/portfolio/edmond-de-belamy/
Google Scholar
[21]
Taesung Park, Alexei A. Efros, Richard Zhang, and Jun-Yan Zhu. 2020. Contrastive Learning for Unpaired Image-to-Image Translation. In European Conference on Computer Vision.
Google Scholar
[22]
Krzysztof Pietroszek, Manuel Rebol, and Becky Lake. 2022. Dill Pickle: Interactive Theatre Play in Virtual Reality. In Proceedings of the 28th ACM Symposium on Virtual Reality Software and Technology. 1–2.
Digital Library
Google Scholar
[23]
David Rokeby. 1986. Very Nervous System. http://www.davidrokeby.com/vns.html
Google Scholar
[24]
Shunsuke Saito, Tomas Simon, Jason Saragih, and Hanbyul Joo. 2020. Pifuhd: Multi-level pixel-aligned implicit function for high-resolution 3d human digitization. In Proceedings of the IEEE/CVF conference on computer vision and pattern recognition. 84–93.
Crossref
Google Scholar
[25]
Constanza Salazar. 2023. Challenging the “Data Body” in New Media Art, 1990s–Present. Afterimage 50, 2 (2023), 93–111.
Crossref
Google Scholar
[26]
Camille Utterback. 1999. Text Rain. https://camilleutterback.com/projects/text-rain/
Google Scholar
[27]
Bernadette Wegenstein. 2010. Body. Critical terms for media studies (2010), 19–34.
Google Scholar
[28]
Yuliang Xiu, Jinlong Yang, Xu Cao, Dimitrios Tzionas, and Michael J. Black. 2023. ECON: Explicit Clothed humans Optimized via Normal integration. In Proceedings of the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR).
Google Scholar
[29]
Daniel Zeidler and Matthew McGinity. 2023. Bodylab: in virtuo sculpting, painting and performing of full-body avatars. Proceedings of the ACM on Computer Graphics and Interactive Techniques 6, 2 (2023), 1–12.
Digital Library
Google Scholar
[30]
Zerong Zheng, Tao Yu, Yixuan Wei, Qionghai Dai, and Yebin Liu. 2019. DeepHuman: 3D Human Reconstruction from a Single Image. In The IEEE International Conference on Computer Vision (ICCV).
Crossref
Google Scholar
[31]
Qian-Yi Zhou, Jaesik Park, and Vladlen Koltun. 2018. Open3D: A Modern Library for 3D Data Processing. CoRR abs/1801.09847 (2018). arXiv:1801.09847 http://arxiv.org/abs/1801.09847
Google Scholar
[32]
Joanna Zylinska. 2020. AI art: machine visions and warped dreams. Open Humanities Press.
Google Scholar
