“Display Methods of Projection Augmented Reality based on Deep Learning Pose Estimation” by Ro, Byun, Park and Han

  • ©Hyocheol Ro, Jung-Hyun Byun, Yoon Jung Park, and Tack-Don Han

  • ©Hyocheol Ro, Jung-Hyun Byun, Yoon Jung Park, and Tack-Don Han

Conference:


Type:


Entry Number: 55

Title:

    Display Methods of Projection Augmented Reality based on Deep Learning Pose Estimation

Presenter(s)/Author(s):


Abstract:


    In this paper, we propose three display methods for projection based augmented reality. In spatial augmented reality (SAR), determining where information, objects, or contents are to be displayed is a difficult and important issue. We use deep learning models to estimate user pose and suggest ways to solve the issue based on this data. Finally, each method can be appropriately applied according to various applications and scenarios.

References:


    • 2019. Runway. https://runwayapp.ai/ 
    • Oliver Bimber and Ramesh Raskar. 2005. Spatial augmented reality: merging real and virtual worlds. AK Peters/CRC Press. 
    • Henry Chen, Austin S Lee, Mark Swift, and John C Tang. 2015. 3D collaboration method over HoloLensâĎć and SkypeâĎć end points. In Proceedings of the 3rd International Workshop on Immersive Media Experiences. ACM, 27–30. 
    • Andreas Fender, David Lindlbauer, Philipp Herholz, Marc Alexa, and Jörg Müller. 2017. HeatSpace: Automatic Placement of Displays by Empirical Analysis of User Behavior. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 611–621. 
    • Shafaq Mussadiq, Rehan Hafiz, and Muhammad Abdullah Jamal. 2017. Confined projection on selected sub-surface using a robust binary-coded pattern for picoprojectors. Multimedia Systems 23, 2 (2017), 207–222. 
    • George Papandreou, Tyler Zhu, Nori Kanazawa, Alexander Toshev, Jonathan Tompson, Chris Bregler, and Kevin Murphy. 2017. Towards accurate multi-person pose estimation in the wild. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition. 4903–4911.
    • Hyocheol Ro, Jung-Hyun Byun, Inhwan Kim, Yoon Jung Park, Kyuri Kim, and Tack-Don Han. 2019. Projection-Based Augmented Reality Robot Prototype with HumanAwareness. In 2019 14th ACM/IEEE International Conference on Human-Robot Interaction (HRI). IEEE, 598–599.
    • Hyocheol Ro, Inhwan Kim, JungHyun Byun, Yoonsik Yang, Yoon Jung Park, Seungho Chae, and Tackdon Han. 2018. PAMI: Projection Augmented Meeting Interface for Video Conferencing. In 2018 ACM Multimedia Conference on Multimedia Conference. ACM, 1274–1277.

Keyword(s):


Acknowledgements:


    This work was supported by the National Research Foundation of Korea(NRF) grant funded by the Korea government(MSIP) (No.NRF2018R1A2A1A05078628).

PDF:


Overview Page: