“SonalShooter: a spatial augmented reality system using handheld directional speaker with camera” by Nakagaki and Kakehi

Mainly in the field of Augmented Reality (AR), various systems that can overlap virtual information onto physical space in the real world have been developed. In such systems, wearing special equipment might obstruct users’ natural interaction and communication. Contrarily, Spatial Augmented Reality, which project additional information directly on the targeted physical space, has attracted much attention. In our research, we aim to provide a novel auditory interaction with physical surfaces through the approach of Spatial Augmented Reality. Our system, named SonalShooter, can give auditory information to physical objects (Figure 1). When a user aims the device at a physical object, the device detects and identifies the target with a computer vision approach and he/she will be able to hear corresponding auditory information from the object itself as if it is speaking.

1. Ishii, K., Yamamoto, Y., Imai, M., and Nakadai, K. 2007. A navigation system using ultrasonic directional speaker with rotating base. In Proceedings of the 12th International Conference on Human-Computer Interaction, Springer LNCS, Volume 4558, 526–535.
2. Nishimura, T., Itoh, H., Nakamura, Y., Yamamoto, Y., and Nakashima, H. 2004. A compact battery-less information terminal for real world interaction. In Proceedings of Pervasive 2004, Springer LNCS, Volume 3001, 124–139.