“Exploring the use of mobile AR to aid decision-making on-the-go” by Soeltz, Hickey, Kostic, Lin and Swamy

  • ©W. Kyle Soeltz, Jeff Hickey, Zona Kostic, Anna Lin, and Kartik Swamy



    Exploring the use of mobile AR to aid decision-making on-the-go



    Extended reality adaptation is gaining traction across a broad spectrum of disciplines. Mobile phones and markerless augmented reality (AR) are fascinating methods for retrieving information because they enable content to be rendered in the user’s immediate environment while they are on the move. This method of rendering virtual content within a physical environment will be accessible to a large audience that, for the most part, does not have access to high-end equipment such as head-mounted displays. Along with a large audience, augmented reality on mobile devices can display dynamic content in real time, even in outdoor settings, providing users with information about physical artifacts that is both immediate and contextually relevant. The purpose of this paper is to discuss the development of a mobile application that will assist users in making on-the-spot decisions based on online content displayed nearby. Along with developing an application that assists users in locating nearby restaurants, a strong emphasis is placed on architecture, user interface, and experience design, as the application will be used in environments with limited focus (e.g., traffic noise or occlusion with real objects). The study concludes with a discussion of the application’s user experience and future research directions in this field. With the rapid evolution of mobile devices, it is critical to understand some of the challenges and design constraints inherent in developing better user experiences for applications that support on-the-go decision-making.


    1. Marco de Sá and Elizabeth Churchill. 2012. Mobile Augmented Reality: Exploring Design and Prototyping Techniques. In Proceedings of the 14th International Conference on Human-Computer Interaction with Mobile Devices and Services (San Francisco, California, USA) (MobileHCI ’12). Association for Computing Machinery, New York, NY, USA, 221–230. https://doi.org/10.1145/2371574.2371608
    2. Kyohei Hakka, Toshiya Isomoto, and Buntarou Shizuki. 2019. One-Handed Interaction Technique for Single-Touch Gesture Input on Large Smartphones. In Symposium on Spatial User Interaction (New Orleans, LA, USA) (SUI ’19). Association for Computing Machinery, New York, NY, USA, Article 21, 2 pages. https://doi.org/10.1145/3357251.3358750
    3. Zona Kostic, Jared Jessup, Jeffrey Baglioni, Nathan T. Weeks, Johann Philipp Dreessen, Ning Chen, and Tianyu Liu. 2020. Visual Companion for Booklovers. CoRR abs/2011.00329(2020). arXiv:2011.00329https://arxiv.org/abs/2011.00329
    4. Blair MacIntyre, Hafez Rouzati, and Martin Lechner. 2013. Walled Gardens: Apps and Data as Barriers to Augmenting Reality. IEEE Computer Graphics and Applications 33, 3 (2013), 77–81. https://doi.org/10.1109/MCG.2013.51


ACM Digital Library Publication:

Overview Page: