“SecondSight: Demonstrating Cross-device AR Interaction” by Reichherzer, Fraser and Billinghurst

  • ©Carolin Reichherzer, Jack Fraser, and Mark Nathan Billinghurst


Entry Number: 06


    SecondSight: Demonstrating Cross-device AR Interaction

Program Title:

    Immersive Interaction - New Modalities



    SecondSight is a framework for rapid prototyping of cross-device interfaces that combine an optical see-through Augmented Reality (AR) head-mounted display (HMD) with a smartphone. SecondSight contains code for simulating AR HMDs with different Fields of View (FOV), providing gesture and head pointing input, and allowing virtual content to be placed in different coordinate frames. Overall, this gives AR researchers flexibility to explore different types of cross-device interfaces and interaction techniques with different types of display, input, and content placement.


    1. Fengyuan Zhu, and Tovi Grossman. 2020. Bishare: Exploring bidirectional interactions between smartphones and head-mounted augmented reality. In In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI 2020). Association for Computing Machinery, New York, NY, USA, 1-14. DOI: https://doi.org/10.1145/3313831.3376233
    2. Nreal. 2021. Nreal AR display website: https://www.nreal.ai/
    3. OptiTrack. 2021. OptiTrack website: https://optitrack.com

Additional Images:

©Carolin Reichherzer, Jack Fraser, and Mark Nathan Billinghurst ©Carolin Reichherzer, Jack Fraser, and Mark Nathan Billinghurst

ACM Digital Library Publication:

Overview Page: