DFM: A Performance Baseline for Deep Feature Matching

2021-01-01
Efe, Ufuk
Ince, Kutalmis Gokalp
Alatan, Abdullah Aydın
A novel image matching method is proposed that utilizes learned features extracted by an off-the-shelf deep neural network to obtain a promising performance. The proposed method uses pre-trained VGG architecture as a feature extractor and does not require any additional training specific to improve matching. Inspired by well-established concepts in the psychology area, such as the Mental Rotation paradigm, an initial warping is performed as a result of a preliminary geometric transformation estimate. These estimates are simply based on dense matching of nearest neighbors at the terminal layer of VGG network outputs of the images to be matched. After this initial alignment, the same approach is repeated again between reference and aligned images in a hierarchical manner to reach a good localization and matching performance. Our algorithm achieves 0.57 and 0.80 overall scores in terms of Mean Matching Accuracy (MMA) for 1 pixel and 2 pixels thresholds respectively on Hpatches dataset [4], which indicates a better performance than the state-of-the-art.
IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR)

Suggestions

A NOVEL LEARNING-BASED IMAGE MATCHING APPROACH BASED ON MUTUAL NEAREST NEIGHBOR SEARCH WITH RATIO TEST
Efe, Ufuk; Alatan, Abdullah Aydın; Department of Electrical and Electronics Engineering (2021-9-09)
This thesis proposes a novel image matching method that utilizes learned features extracted by an off-the-shelf deep neural network to obtain a promising performance. The proposed method simply uses a pre-trained VGG architecture as a feature extractor and does not require any additional training to improve matching. Inspired by well-established concepts in the psychology area, such as the Mental Rotation paradigm, an initial warping step is also performed by the help of a preliminary geometric transformati...
Position estimation for timing belt drives of precision machinery using structured neural networks
KILIÇ, Ergin; DOĞRUER, CAN ULAŞ; Dölen, Melik; Koku, Ahmet Buğra (2012-05-01)
This paper focuses on a viable position estimation scheme for timing-belt drives using artificial neural networks. In this study, the position of a carriage (load) is calculated via a structured neural network topology accepting input from a position sensor on the actuator side of the timing belt. The paper presents a detailed discussion on the source of transmission errors. The characteristics of the error in different operation regimes are exploited to construct different network topologies. That is, a re...
E3D-D2D: EMBEDDING IN 3D, DETECTION IN 2D THROUGH PROJECTIVE INVARIANTS
Yasaroglu, Yagiz; Alatan, Abdullah Aydın (2014-10-30)
A novel watermarking method is presented in which the data embedded into a 3D model is extracted from an arbitrary 2D view by using a perspective projective invariant. The data is embedded into 3D positions of selected interest points on a 3D mesh. Determining the interest point modification vectors for ensuring watermark detection constitutes an important part of the proposed method. Different watermark embedding schemes based on optimization of the watermark function are implemented and evaluated. Another...
Representing temporal knowledge in connectionist expert systems
Alpaslan, Ferda Nur (1996-09-27)
This paper introduces a new temporal neural networks model which can be used in connectionist expert systems. Also, a Variation of backpropagation algorithm, called the temporal feedforward backpropagation algorithm is introduced as a method for training the neural network. The algorithm was tested using training examples extracted from a medical expert system. A series of experiments were carried out using the temporal model and the temporal backpropagation algorithm. The experiments indicated that the alg...
Image compression using random neural networks
Sungur, M (1998-10-28)
Random neural network is a novel pulsed neural network model which has nice analytical features. In this paper, we review the use of the random neural network for the lossy compression of digital gray level images.
Citation Formats
U. Efe, K. G. Ince, and A. A. Alatan, “DFM: A Performance Baseline for Deep Feature Matching,” presented at the IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR), ELECTR NETWORK, 2021, Accessed: 00, 2021. [Online]. Available: https://hdl.handle.net/11511/94417.