“IM6D: magnetic tracking system with 6-DOF passive markers for dexterous 3D interaction and motion” by Huang, Mori, Takashima, Hashi and Kitamura
Conference:
Type(s):
Title:
- IM6D: magnetic tracking system with 6-DOF passive markers for dexterous 3D interaction and motion
Session/Category Title: Tracking and Transients
Presenter(s)/Author(s):
Abstract:
We propose IM6D, a novel real-time magnetic motion-tracking system using multiple identifiable, tiny, lightweight, wireless and occlusion-free markers. It provides reasonable accuracy and update rates and an appropriate working space for dexterous 3D interaction. Our system follows a novel electromagnetic induction principle to externally excite wireless LC coils and uses an externally located pickup coil array to track each of the LC coils with 5-DOF. We apply this principle to design a practical motion-tracking system using multiple markers with 6-DOF and to achieve reliable tracking with reasonable speed. We also solved the principle’s inherent dead-angle problem. Based on this method, we simulated the configuration of parameters for designing a system with scalability for dexterous 3D motion. We implemented an actual system and applied a parallel computation structure to increase the tracking speed. We also built some examples to show how well our system works for actual situations.
References:
1. 5DT. http://www.5dt.com/.
2. Ascension. http://www.ascension-tech.com/.
3. Chan, L., Liang, R.-H., Tsai, M.-C., Cheng, K.-Y., Su, C.-H., Chen, M. Y., Cheng, W.-H., and Chen, B.-Y. 2013. Fingerpad: Private and subtle interaction using fingertips. In Proceedings of the Symposium on User Interface Software and Technology, ACM, 255–260.
4. Chen, K.-Y., Lyons, K., White, S., and Patel, S. 2013. utrack: 3D input using two magnetic sensors. In Proceedings of the Symposium on User Interface Software and Technology, ACM, 237–244.
5. CyberGlove. http://www.cyberglovesystems.com/.
6. Daniel Vlasic, Rolf Adelsberger, G. V. J. B. M. G. W. M., and Popovic, J. 2007. Practical motion capture in everyday surroundings. In Proceedings of SIGGRAPH, 1932–1936.
7. Foxlin, E., and Durlach, N. 1994. An inertial head-orientation tracker with automatic drift compensation for use with hmd’s. In Proceedings of the Symposium on Virtual Reality Software and Technology, ACM, 159–174.
8. Foxlin, E., Harrington, M., and Pfeifer, G. 1998. Constellation: a wide-range wireless motion-tracking system for augmented reality and virtual set applications. In Proceedings of SIGGRAPH, 371–378.
9. Grossman, T., Wigdor, D., and Balakrishnan, R. 2004. Multi-Enger gestural interaction with 3D volumetric displays. In Proceedings of the Symposium on User Interface Software and Technology, ACM, 61–70.
10. Harrison, C., and Hudson, S. E. 2009. Abracadabra: Wireless, high-precision, and unpowered finger input for very small mobile devices. In Proceedings of the Symposium on User Interface Software and Technology, ACM, 121–124.
11. Hashi, S., Toyoda, M., Yabukami, S., Ishiyama, K., Okazaki, Y., Arai, K. I., and Kanetaka, H. 2008. Wireless magnetic motion capture system using multiple LC resonant magnetic markers with high accuracy. Sensors and Actuators A: Physical 142, 2, 520–527.
12. Hashi, S., Yabukami, S., Kanetaka, H., Ishiyama, K., and Arai, K.-I. 2009. Numerical study on the improvement of detection accuracy for a wireless motion capture system. IEEE Transactions on Magnetics, 45, 6 (June), 2736–2739.
13. Hilliges, O., D. Kim, S. I., Weiss, M., and Wilson, A. 2012. Holodesk: direct 3D interactions with a situated see-through display. In Proceedings of the Conference on Human Factors in Computing Systems, ACM, 2421–2430.
14. Huang, J., Takashima, K., Hashi, S., and Kitamura, Y. 2014. IM3D: Magnetic motion tracking system for dexterous 3D interactions. In SIGGRAPH Emerging Technologies, 12:1.
15. Nakagawa, T., and Koyanagi, Y. 1982. Experimental Data Analysis by the Least Square Method. The University of Tokyo Press.
16. Paradiso, J. A., Pardue, L. S., Hsiao, K.-Y., and Benbasat, A. Y. 2003. Electromagnetic tagging for electronic music interfaces. Journal of New Music Research 32, 395–409.
17. Polhemus. http://polhemus.com/.
18. Raab, F., Blood, E., Steiner, T., and Jones, H. 1979. Magnetic position and orientation tracking system. IEEE Transactions on Aerospace and Electronic Systems AES-15, 5 (Sept.), 709–718.
19. Ribo, M., Pinz, A., and Fuhrmann, A. L. 2001. A new optical tracking system for virtual and augmented reality applications. In Proceedings of the IEEE Instrumentation and Measurement Technology Conference, 1932–1936.
20. Sandilands, P., Choi, M., and Komura, T. 2012. Capturing close interactions with objects using a magnetic motion capture system and a rgbd sensor. In Motion in Games, M. Kallmann and K. Bekris, Eds., vol. 7660 of Lecture Notes in Computer Science. Springer Berlin Heidelberg, 220–231.
21. Sharp, T., Keskin, C., Robertson, D., Taylor, J., Shotton, J., Kim, D., Rhemann, C., Leichter, I., Vinnikov, A., Wei, Y., Freedman, D., Kohli, P., Krupka, E., Fitzgibbon, A., and Izadi, S. 2015. Accurate, robust, and flexible real-time hand tracking. In Proceedings of the Conference on Human Factors in Computing Systems, ACM, 3633–3642.
22. Shiratori, T., Park, H. S., Sigal, L., Sheikh, Y., and Hodgins, J. K. 2011. Motion capture from body-mounted cameras. ACM Transaction on Graphics. 30, 4 (July), 31:1–31:10.
23. Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. 2011. Real-time human pose recognition in parts from single depth images. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition, 1297–1304.
24. Song, P., Yu, H., and Winkler, S. 2008. Vision-based 3D finger interactions for mixed reality games with physics simulation. In Proceedings of ACM SIGGRAPH International Conference on Virtual-Reality Continuum and Its Applications in Industry, 7:1–7:6.
25. Sutherland, I. 1968. A head-mounted three dimensional display. In Proceedings of Fall Joint Computer Conference, 1, 757–764.
26. Tang, D., Yu, T.-H., and Kim, T.-K. 2013. Real-time articulated hand pose estimation using semi-supervised transductive regression forests. In Proceedings of IEEE International Conference on Computer Vision, 3224–3231.
27. Tompson, J., Stein, M., LeCun, Y., and Perlin, K. 2014. Real-time continuous pose recovery of human hands using convolutional networks. ACM Transaction on Graphics, 33, 5 (Sept.), 169:1–169:10.
28. Virtual Realities. http://www.vrealities.com/.
29. Wang, Y., and Neff, M. 2013. Data-driven glove calibration for hand motion capture. In Proceedings of the Symposium on Computer Animation, ACM, 15–24.
30. Wang, R. Y., and Popovic, J. 2009. Real-time hand-tracking with a color glove. ACM Transactions on Graphics, 28, 63 (Aug.), 63:1–63:8.
31. Wang, Y., Min, J., Zhang, J., Liu, Y., Xu, F., Dai, Q., and Chai, J. 2013. Video-based hand manipulation capture through composite motion control. ACM Transactions on Graphics, 43, 32 (July), 43:1–43:13.
32. Yabukami, S., Hashi, S., Tokunaga, Y., Arai, K., and Okazaki, Y. 2004. Development of a position-sensing system for a wireless magnetic marker. Journal of the Magnetics Society of Japan 28, 877–885 (in Japanese).
33. Yabukami, S., Ogasawara, K., Saitoh, H., Hashi, S., Toyoda, M., Okazaki, Y., and Arai, K. 2007. Development of a fingertip position-sensing system using LC resonated markers. Journal of the Magnetics Society of Japan 31, 439–444 (in Japanese).
34. Zhang, P., Siu, K., Zhang, J., Liu, C. K., and Chai, J. 2014. Leveraging depth cameras and wearable pressure sensors for full-body kinematics and dynamics capture. ACM Transaction on Graphics, 33, 6 (Nov.), 221:1–221:14.
35. Zhao, W., Chai, J., and Xu, Y.-Q. 2012. Combining marker-based mocap and rgb-d camera for acquiring high-fidelity hand motion data. In Proceedings of the SIGGRAPH/Eurographics Symposium on Computer Animation, 33–42.
36. Zimmerman, T. G., Lanier, J., Blanchard, C., Bryson, S., and Harvill, Y. 1987. A hand gesture interface device. In Proceedings of the Conference on Human Factors in Computing Systems and Graphics Interface, ACM, 189–192.
