“ImmerseSketch: Transforming Creative Prompts into Vivid 3D Environments in VR” by Lan, Tsai, Huang, Ching, Pan, et al. …
Conference:
Type(s):
Title:
- ImmerseSketch: Transforming Creative Prompts into Vivid 3D Environments in VR
Session/Category Title: Interactive Techniques
Presenter(s)/Author(s):
Abstract:
ImmerseSketch is a VR creative system powered by generative AI. It can generate immersive environments and reference objects to assist artists in sketching and ideation processes. Artists can generate an environment mesh with and obtain 3D models through the system as reference. Facilitating their creative process.
References:
[1]
Timothy Chen, Miguel Ying Jie Then, Jing-Yuan Huang, Yang-Sheng Chen, Ping-Hsuan Han, and Yi-Ping Hung. 2023. sPellorama: An Immersive Prototyping Tool using Generative Panorama and Voice-to-Prompts. In ACM SIGGRAPH 2023 Posters (Los Angeles, CA, USA) (SIGGRAPH ?23). Association for Computing Machinery, New York, NY, USA, Article 42, 2 pages. https://doi.org/10.1145/3588028.3603667
[2]
Mengyang Feng, Jinlin Liu, Miaomiao Cui, and Xuansong Xie. 2023. Diffusion360: Seamless 360 Degree Panoramic Image Generation based on Diffusion Models. arXiv preprint arXiv:2311.13141 (2023).
[3]
Minghua Liu, Chao Xu, Haian Jin, Linghao Chen, Mukund Varma T, Zexiang Xu, and Hao Su. 2024. One-2-3-45: Any single image to 3d mesh in 45 seconds without per-shape optimization. Advances in Neural Information Processing Systems 36 (2024).
[4]
Michael Nebeling and Katy Madier. 2019. 360proto: Making interactive virtual reality & augmented reality prototypes from paper. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1?13.
[5]
Maximilian Speicher, Katy Lewis, and Michael Nebeling. 2021. Designers, the stage is yours! medium-fidelity prototyping of augmented & virtual reality interfaces with 360theater. Proceedings of the ACM on human-computer interaction 5, EICS (2021), 1?25.
[6]
Lihe Yang, Bingyi Kang, Zilong Huang, Xiaogang Xu, Jiashi Feng, and Hengshuang Zhao. 2024. Depth anything: Unleashing the power of large-scale unlabeled data. arXiv preprint arXiv:2401.10891 (2024).
