“Multi-feature matching of fresco fragments”
Conference:
Type(s):
Title:
- Multi-feature matching of fresco fragments
Session/Category Title: 3D modeling
Presenter(s)/Author(s):
Moderator(s):
Abstract:
We present a multiple-feature approach for determining matches between small fragments of archaeological artifacts such as Bronze-Age and Roman frescoes. In contrast with traditional 2D and 3D shape matching approaches, we introduce a set of feature descriptors that are based on not only color and shape, but also normal maps. These are easy to acquire and combine high data quality with discriminability and robustness to some types of deterioration. Our feature descriptors range from general-purpose to domain-specific, and are quick to compute and match. We have tested our system on three datasets of fresco fragments, demonstrating that multi-cue matching using different subsets of features leads to different tradeoffs between efficiency and effectiveness. In particular, we show that normal-based features are more effective than color-based ones at similar computational complexity, and that 3D features are more discriminative than ones based on 2D or normals, but at higher computational cost. We also demonstrate how machine learning techniques can be used to effectively combine our new features with traditional ones. Our results show good retrieval performance, significantly improving upon the match prediction rate of state-of-the-art 3D matching algorithms, and are expected to extend to general matching problems in applications such as texture synthesis and forensics.
References:
1. Brown, B. J., Toler-Franklin, C., Nehab, D., Burns, M., Dobkin, D., Vlachopoulos, A., Doumas, C., Rusinkiewicz, S., and Weyrich, T. 2008. A System for High-Volume Acquisition and Matching of Fresco Fragments: Reassembling Theran Wall Paintings. ACM Transactions on Graphics (Proc. SIGGRAPH), Vol. 27, No. 3 (Aug.). Google ScholarDigital Library
2. Fornasier, M., and Toniolo, D. 2005. Fast, robust and efficient 2D pattern recognition for re-assembling fragmented images. Pattern Recognition, Vol. 38, No. 11 (Nov). Google ScholarDigital Library
3. Huang, Q.-X., Flöry, S., Gelfand, N., Hofer, M., and Pottmann, H. 2006. Reassembling Fractured Objects by Geometric Matching. ACM Transactions on Graphics (Proc. SIGGRAPH), Vol. 25, No. 3. Google ScholarDigital Library
4. Karasik, A., and Smilansky, U. 2007. 3D scanning technology as a standard archaeological tool for pottery analysis: practice and theory. Journal of Archaeological Science.Google Scholar
5. Koller, D., Trimble, J., Najbjerg, T., Gelfand, N., and Levoy, M. 2006. Fragments of the City: Stanford’s Digital Forma Urbis Romae Project. In Proceedings of the Third Williams Symposium on Classical Architecture, Journal of Roman Archaeology, vol. Suppl. 61, 237–252.Google Scholar
6. Kong, W., and Kimia, B. 2001. On Solving 2D and 3D Puzzles under Curve Matching. CVPR, Vol. 2, No. 10 (aug), 583.Google Scholar
7. Leitão, H. C. G., and Stolfi, J. 2002. A Multiscale Method for the Reassembly of Two-Dimensional Fragmented Objects. IEEE Transactions on Pattern Analysis and Machine Intelligence, Vol. 24, No. 9 (Sept.), 1239–1251. Google ScholarDigital Library
8. Manay, S., Yezzi, A. J., Hong, B. W., and Soatto, S. 2004. Integral Invariant Signatures. In Proc. ECCV, 87–99.Google Scholar
9. Papaodysseus, C., Panagopoulos, T., Exarhos, M., Triantafillou, C., Fragoulis, D., and Doumas, C. 2002. Contour-Shape Based Reconstruction of Fragmented, 1600 BC Wallpaintings. IEEE Trans. on Signal Processing, Vol. 50, No. 6. Google ScholarDigital Library
10. Pintus, R., Malzbender, T., Wang, O., Bergman, R., Nachlieli, H., and Ruckenstein, G. 2009. Photo Repair and 3D Structure from Flatbed Scanners. In Proc. VISAPP.Google Scholar
11. Quinlan, J. R. 1993. C4.5: Programs for Machine Learning. Morgan Kaufmann. Google ScholarDigital Library
12. Saǧiroǧlu, M. Ş., and Erçil, A. 2006. A Texture Based Matching Approach for Automated Assembly of Puzzles. In ICPR ’06: Proceedings of the 18th International Conference on Pattern Recognition, IEEE Computer Society, Washington, DC, USA, 1036–1041. Google ScholarDigital Library
13. Serra, J. 1983. Image Analysis and Mathermatical Morphology. Academic Press. Google ScholarDigital Library
14. Willis, A. 2004. Stochastic 3D Geometric Models for Classification, Deformation, and Estimation. Ph.D. Thesis (may). Google ScholarDigital Library
