“Video augmented reality with robust tracking” by Birkbeck, Cheng and Basu

  • ©Neil Birkbeck, Irene Cheng, and Anup Basu

  • ©Neil Birkbeck, Irene Cheng, and Anup Basu




    Video augmented reality with robust tracking



    The goal of our research is to augment a 3D scene with video for a variety of applications, including entertainment and advertisement. In an entertainment application we could add video on to a 3D games environment to both add realism and allow players to pick up clues from video clips. For advertisement, we could add videos of popular soft drinks into a movie; for example, a video advertisement could be added on the side of a building as a helicopter flies by. To make video augmented reality possible, and robust, we need to address several issues; camera registration and rendering, tracking of certain feature planes (e.g., the side of a building or the top of a roof), integrating video into a 3D scene, and invariance to illumination variations, being some important ones.  



    1. {Art} Artoolkit homepage. http://www.hitl.washington.edu/artoolkit/.
    2. {BB02} J. M. Buenaposada and L. Baumela, “Real-time tracking and estimation of plane pose,” International Conference on Pattern Recognition, 697–700, 2002.
    3. {BMB03} J. M. Buenaposada, E. Munoz, and L. Baumela, “Tracking heads using piecewise planar models,” Iberian Conf. on Pattern Recognition and Image Analysis, 126–133, 2003.
    4. {CYJ02} D. Cobzas K. Yerex, and M. Jagersand, “Dynamic Textures for Image-Based Rendering of Fine-Scale 3D Structure and Animation of Non-Rigid Motion,” Computer Graphics Forum, 21(3), 2002,
    5. {FTV01} V. Ferrari, T. Tuytelaars, and L. Van Gool, ‘Markerless augmented reality with a real-time affine region tracker,” IEEE and ACM Intl. Symposium on Augmented Reality, 87–96, October 2001.
    6. {PP04}H. Park and J-I. Park, “Invisible marker tracking for ar,” IEEE and ACM International Symposium on Mixed and Augmented Reality, 272–273, 2004.
    7. {SFZ00} G. Simon, A. Fitzgibbon, and A. Zisserman, “Markerless tracking using planar structures in the scene,” International Symposium on Augmented Reality, 120–128, October 2000.

Additional Images:

©Neil Birkbeck, Irene Cheng, and Anup Basu

ACM Digital Library Publication:

Overview Page: