“Proactive 3D scanning of inaccessible parts” by Yan, Sharf, Lin, Huang and Chen

  • ©Feilong Yan, Andrei Sharf, Wenzhen Lin, Hui Huang, and Baoquan Chen

Conference:


Type:


Title:

    Proactive 3D scanning of inaccessible parts

Session/Category Title: Depth for All Occasions

Presenter(s)/Author(s):


Moderator(s):


Abstract:


    The evolution of 3D scanning technologies have revolutionized the way real-world object are digitally acquired. Nowadays, high-definition and high-speed scanners can capture even large scale scenes with very high accuracy. Nevertheless, the acquisition of complete 3D objects remains a bottleneck, requiring to carefully sample the whole object’s surface, similar to a coverage process. Holes and undersampled regions are common in 3D scans of complex-shaped objects with self occlusions and hidden interiors. In this paper we introduce the novel paradigm of proactive scanning, in which the user actively modifies the scene while scanning it, in order to reveal and access occluded regions. We take a holistic approach and integrate the user interaction into the continuous scanning process. Our algorithm allows for dynamic modifications of the scene as part of a global 3D scanning process. We utilize a scan registration algorithm to compute motion trajectories and separate between user modifications and other motions such as (hand-held) camera movements and small deformations. Thus, we reconstruct together the static parts into a complete unified 3D model. We evaluate our technique by scanning and reconstructing 3D objects and scenes consisting of inaccessible regions such as interiors, entangled plants and clutter.

References:


    1. Amberg, B., Romdhani, S., and Vetter, T. 2007. Optimal step nonrigid icp algorithms for surface registration. In CVPR.Google Scholar
    2. Barber, C. B., Dobkin, D. P., and Huhdanpaa, H. 1996. The quickhull algorithm for convex hulls. ACM TRANSACTIONS ON MATHEMATICAL SOFTWARE 22, 4, 469–483. Google ScholarDigital Library
    3. Besl, P. J., and McKay, N. D. 1992. A method for registration of 3-d shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 2 (Feb.), 239–256. Google ScholarDigital Library
    4. Bouaziz, S., Tagliasacchi, A., and Pauly, M. 2013. Sparse iterative closest point. In Proc. Eurographics Symp. on Geometry Processing, 113–123. Google ScholarDigital Library
    5. Brown, B. J., and Rusinkiewicz, S. 2007. Global non-rigid alignment of 3-d scans. In ACM SIGGRAPH 2007 Papers, ACM, New York, NY, USA, SIGGRAPH ’07. Google ScholarDigital Library
    6. Chang, W., and Zwicker, M. 2008. Automatic registration for articulated shapes. Computer Graphics Forum (Special Issue of Symposium on Geometry Processing) 27, 5, 1459–1468. Google ScholarDigital Library
    7. Chang, W., and Zwicker, M. 2011. Global registration of dynamic range scans for articulated model reconstruction. ACM Trans. Graph. 30, 3 (May), 26:1–26:15. Google ScholarDigital Library
    8. Chen, Y., and Medioni, G. 1992. Object modelling by registration of multiple range images. Image Vision Comput. 10, 3 (Apr.), 145–155. Google ScholarDigital Library
    9. Chui, H., and Rangarajan, A. 2003. A new point matching algorithm for non-rigid registration. Comput. Vis. Image Underst. 89, 2–3 (Feb.), 114–141. Google ScholarDigital Library
    10. de Aguiar, E., Stoll, C., Theobalt, C., Ahmed, N., Seidel, H.-P., and Thrun, S. 2008. Performance capture from sparse multi-view video. In ACM SIGGRAPH 2008 papers, ACM, New York, NY, USA, SIGGRAPH ’08, 98:1–98:10. Google ScholarDigital Library
    11. Horn, B. K. P. 1987. Closed-form solution of absolute orientation using unit quaternions. J. Opt. Soc. Am. A 4, 4 (Apr), 629–642.Google ScholarCross Ref
    12. Huang, Q.-X., Adams, B., Wicke, M., and Guibas, L. J. 2008. Non-rigid registration under isometric deformations. In Proceedings of the Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP ’08, 1449–1457. Google ScholarDigital Library
    13. Izadi, S., Kim, D., Hilliges, O., Molyneaux, D., Newcombe, R., Kohli, P., Shotton, J., Hodges, S., Freeman, D., Davison, A., and Fitzgibbon, A. 2011. Kinect-fusion: Real-time 3d reconstruction and interaction using a moving depth camera. In Proceedings of the ACM Symposium on User Interface Software and Technology, 559–568. Google ScholarDigital Library
    14. Kazhdan, M., Bolitho, M., and Hoppe, H. 2006. Poisson surface reconstruction. In Proceedings of the Fourth Eurographics Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP ’06, 61–70. Google ScholarDigital Library
    15. Li, H., Sumner, R. W., and Pauly, M. 2008. Global correspondence optimization for non-rigid registration of depth scans. In Proceedings of the Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP ’08, 1421–1430. Google ScholarDigital Library
    16. Li, H., Adams, B., Guibas, L. J., and Pauly, M. 2009. Robust single-view geometry and motion reconstruction. In ACM SIGGRAPH Asia 2009 papers, 175:1–175:10. Google ScholarDigital Library
    17. Li, H., Vouga, E., Gudym, A., Luo, L., Barron, J. T., and Gusev, G. 2013. 3d self-portraits. ACM Transactions on Graphics (Proceedings SIGGRAPH Asia 2013) 32, 6 (November). Google ScholarDigital Library
    18. Mitra, N. J., Flory, S., Ovsjanikov, M., Gelfand, N., Guibas, L., and Pottmann, H. 2007. Dynamic geometry registration. In Proceedings of the fifth Eurographics symposium on Geometry processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP ’07, 173–182. Google ScholarDigital Library
    19. Muja, M., and Lowe, D. G. 2009. Fast approximate nearest neighbors with automatic algorithm configuration. In International Conference on Computer Vision Theory and Application VISSAPP’09), INSTICC Press, 331–340.Google Scholar
    20. Pekelny, Y., and Gotsman, C. 2008. Articulated object reconstruction and markerless motion capture from depth video. Computer Graphics Forum 27, 2 (Apr.), 399–408.Google ScholarCross Ref
    21. Sharf, A., Alcantara, D. A., Lewiner, T., Greif, C., Sheffer, A., Amenta, N., and Cohen-Or, D. 2008. Space-time surface reconstruction using incompressible flow. In ACM SIGGRAPH Asia 2008 papers, ACM, New York, NY, USA, SIGGRAPH Asia ’08, 110:1–110:10. Google ScholarDigital Library
    22. Sumner, R. W., Schmid, J., and Pauly, M. 2007. Embedded deformation for shape manipulation. In ACM SIGGRAPH 2007 Papers, ACM, New York, NY, USA, SIGGRAPH ’07. Google ScholarDigital Library
    23. Süssmuth, J., Winter, M., and Greiner, G. 2008. Reconstructing animated meshes from time-varying point clouds. In Proceedings of the Symposium on Geometry Processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP ’08, 1469–1476. Google ScholarDigital Library
    24. Tevs, A., Berner, A., Wand, M., Ihrke, I., Bokeloh, M., Kerber, J., and Seidel, H.-P. 2012. Animation cartography – intrinsic reconstruction of shape and motion. ACM Trans. Graph., 12:1–12:15. Google ScholarDigital Library
    25. Wand, M., Jenke, P., Huang, Q., Bokeloh, M., Guibas, L., and Schilling, A. 2007. Reconstruction of deforming geometry from time-varying point clouds. In Proceedings of the fifth Eurographics symposium on Geometry processing, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, SGP ’07, 49–58. Google ScholarDigital Library
    26. Wand, M., Adams, B., Ovsjanikov, M., Berner, A., Bokeloh, M., Jenke, P., Guibas, L., Seidel, H.-P., and Schilling, A. 2009. Efficient reconstruction of nonrigid shape and motion from real-time 3d scanner data. ACM Trans. Graph. 28, 2 (May), 15:1–15:15. Google ScholarDigital Library

ACM Digital Library Publication:


Overview Page: