Robust estimation of local affine maps and its applications to image matching

Abstract : The classic approach to image matching consists in the detection, description and matching of keypoints. This defines a zero-order approximation of the mapping between two images, determined by corresponding point coordinates. But the patches around keypoints typically contain more information, which may be exploited to obtain a first-order approximation of the mapping, incorporating local affine maps between corresponding keypoints. In this work, we propose a LOCal Affine Transform Estimator (LOCATE) method based on neural networks. We show that LOCATE drastically improves the accuracy of local geometry estimation by tracking inverse maps. A second contribution on guided matching and refinement is presented. The novelty here consists in the use of LOCATE to propose new SIFT-keypoint correspondences with precise locations, orientations and scales. Our experiments show that the precision gain provided by LOCATE does play an important role in applications such as guided matching. The third contribution of this paper consists in a modification to the RANSAC algorithm, that use LOCATE to improve the homography estimation between a pair of images. These approaches outperform RANSAC for different choices of image descriptors and image datasets, and permit to increase the probability of success in identifying image pairs in challenging matching databases. The source codes are available at : https://rdguez-mariano.github.io/pages/locate .
Document type :
Conference papers
Complete list of metadatas

Cited literature [44 references]  Display  Hide  Download

https://hal.archives-ouvertes.fr/hal-02156259
Contributor : Mariano Rodríguez Guerra <>
Submitted on : Wednesday, January 8, 2020 - 3:40:40 PM
Last modification on : Saturday, February 1, 2020 - 1:52:15 AM

File

main_hal.pdf
Files produced by the author(s)

Identifiers

  • HAL Id : hal-02156259, version 3

Citation

Mariano Rodríguez, Gabriele Facciolo, Rafael Grompone von Gioi, Pablo Musé, Julie Delon. Robust estimation of local affine maps and its applications to image matching. Winter Conference on Applications of Computer Vision (WACV ’20), Mar 2020, Colorado, United States. ⟨hal-02156259v3⟩

Share

Metrics

Record views

38

Files downloads

55