“Street slide: browsing street level imagery” by Kopf, Chen, Szeliski and Cohen

Systems such as Google Street View and Bing Maps Streetside enable users to virtually visit cities by navigating between immersive 360° panoramas, or bubbles. The discrete moves from bubble to bubble enabled in these systems do not provide a good visual sense of a larger aggregate such as a whole city block. Multi-perspective “strip” panoramas can provide a visual summary of a city street but lack the full realism of immersive panoramas.We present Street Slide, which combines the best aspects of the immersive nature of bubbles with the overview provided by multi-perspective strip panoramas. We demonstrate a seamless transition between bubbles and multi-perspective panoramas. We also present a dynamic construction of the panoramas which overcomes many of the limitations of previous systems. As the user slides sideways, the multi-perspective panorama is constructed and rendered dynamically to simulate either a perspective or hyper-perspective view. This provides a strong sense of parallax, which adds to the immersion. We call this form of sliding sideways while looking at a street façade a street slide. Finally we integrate annotations and a mini-map within the user interface to provide geographic information as well additional affordances for navigation. We demonstrate our Street Slide system on a series of intersecting streets in an urban setting. We report the results of a user study, which shows that visual searching is greatly enhanced with the Street Slide interface over existing systems from Google and Bing.

1. Agarwala, A., Agrawala, M., Cohen, M., Salesin, D., and Szeliski, R. 2006. Photographing long scenes with multi-viewpoint panoramas. ACM Transactions on Graphics 25, 3 (August), 853–861. Google ScholarDigital Library
2. Buehler, C., Bosse, M., McMillan, L., Gortler, S., and Cohen, M. 2001. Unstructured lumigraph rendering. In SIGGRAPH ’01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, 425–432. Google ScholarDigital Library
3. Chen, S. E. 1995. QuickTime VR — an image-based approach to virtual environment navigation. Computer Graphics (SIGGRAPH’95) (August), 29–38. Google ScholarDigital Library
4. Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The Lumigraph. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Proc. SIGGRAPH’96 (New Orleans), 43–54. Google ScholarDigital Library
5. Gupta, R., and Hartley, R. 1997. Linear pushbroom cameras. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 9 (September), 963–975. Google ScholarDigital Library
6. Igarashi, T., and Hinckley, K. 2000. Speed-dependent automatic zooming for browsing large documents. In UIST ’00: Proceedings of the 13th annual ACM symposium on User interface software and technology, ACM, New York, NY, USA, 139–148. Google ScholarDigital Library
7. Kopf, J., Uyttendaele, M., Deussen, O., and Cohen, M. F. 2007. Capturing and viewing gigapixel images. ACM Transactions on Graphics 26, 3 (August). Google ScholarDigital Library
8. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3 (July), 277–286. Google ScholarDigital Library
9. Levoy, M., and Hanrahan, P. 1996. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Proc. SIGGRAPH’96 (New Orleans), 31–42. Google ScholarDigital Library
10. Lippman, A. 1980. Movie maps: An application of the optical videodisc to computer graphics. Computer Graphics (SIGGRAPH’80) 14, 3 (July), 32–43. Google ScholarDigital Library
11. McMillan, L., and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. Computer Graphics (SIGGRAPH’95) (August), 39–46. Google ScholarDigital Library
12. Peleg, S., Rousso, B., Rav-Acha, A., and Zomet, A. 2000. Mosaicing on adaptive manifolds. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 10 (October), 1144–1154. Google ScholarDigital Library
13. Peleg, R., Ben-Ezra, M., and Pritch, Y. 2001. Omnistereo: Panoramic stereo imaging. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 3 (March), 279–290. Google ScholarDigital Library
14. Rademacher, P., and Bishop, G. 1998. Multiple-center-of-projection images. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Proc. SIGGRAPH’98 (Orlando), 199–206. Google ScholarDigital Library
15. Rav-Acha, A., Engel, G., and Peleg, S. 2008. Minimal aspect distortion (MAD) mosaicing of long scenes. International Journal of Computer Vision 78, 2–3 (July), 187–206. Google ScholarDigital Library
16. Román, A., and Lensch, H. P. A. 2006. Automatic multi-perspective images. In Eurographics Symposium on Rendering, 83–92. Google ScholarDigital Library
17. Román, A., Garg, G., and Levoy, M. 2004. Interactive design of multi-perspective images for visualizing urban landscapes. In IEEE Visualization 2004, 537–544. Google ScholarDigital Library
18. Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: Exploring photo collections in 3D. ACM Transactions on Graphics 25, 3 (August), 835–846. Google ScholarDigital Library
19. Szeliski, R. 2006. Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Computer Vision 2, 1 (December). Google ScholarDigital Library
20. Uyttendaele, M., Criminisi, A., Kang, S. B., Winder, S., Hartley, R., and Szeliski, R. 2004. Image-based interactive exploration of real-world environments. IEEE Computer Graphics and Applications 24, 3 (May/June), 52–63. Google ScholarDigital Library
21. Vincent, L. 2007. Taking online maps down to street level. Computer 40, 12 (December), 118–120. Google ScholarDigital Library
22. Zomet, A., Feldman, D., Peleg, S., and Weinshall, D. 2003. Mosaicing new views: The crossed-slits projection. IEEE Transaction on PAMI (June), 741–754. Google ScholarDigital Library