“Immersivemote: Combining Foveated AI and Streaming for Immersive Remote Operations” by Lungaro and Tollmar
Conference:
Type:
Entry Number: 17
Title:
- Immersivemote: Combining Foveated AI and Streaming for Immersive Remote Operations
Presenter(s)/Author(s):
Abstract:
Immersivemote is a novel technology combining our former foveated streaming solution with our novel foveated AI concept. While we have previously shown that foveated streaming can achieve 90% bandwidth savings, as compared to existing streaming solutions, foveated AI is designed to enable real-time video augmentations that are controlled through eye-gaze. The combined solution is therefore capable of effectively interfacing remote operators with mission critical information obtained, in real time, from task-aware machine understanding of the scene and IoT data.
References:
Stephen M. Casner, Edwin L. Hutchins, and Don Norman. 2016. The Challenges of Partially Automated Driving. Commun. ACM 59, 5 (April 2016), 70–77. https: //doi.org/10.1145/2830565
Ericsson. 2017. Remote monitoring and control of vehicles – Ericsson. https://www. ericsson.com/en/mobility-report/remote-monitoring-and-control-of-vehicles GSMA. 2018. Intelligent Connectivity: the Fusion of 5G, AI and IoT. https://www. gsma.com/iot/news/intelligent-connectivity-5g-ai-iot/
Brian Guenter, Mark Finch, Steven Drucker, Desney Tan, and John Snyder. 2012. Foveated 3D Graphics. ACM Trans. Graph. 31, 6 (Nov. 2012), 164:1–164:10. https: //doi.org/10.1145/2366145.2366183
Pietro Lungaro, Rickard Sjoberg, Alfredo Jose Fanghella Valero, Ashutosh Mittal, and Konrad Tollmar. 2018. Gaze-Aware Streaming Solutions for the Next Generation of Mobile VR Experiences. IEEE Transactions on Visualization and Computer Graphics 24, 4 (April 2018), 1535–1544. https://doi.org/10.1109/TVCG.2018.2794119
Marvin Minksy. 1980. Telepresence. https://web.media.mit.edu/~minsky/papers/ Telepresence.html
John Pretlove and Charlotte Skourup. 2007. Human in the loop. ABB Review 1 (2007), 6–10.
Joseph Redmon and Ali Farhadi. 2018. YOLOv3: An Incremental Improvement. arXiv (2018).
