Visible light infrared matching algorithm based on improved SuperPoint and linear converter

Abstract

In order to solve the problems of high difficulty and mismatch rate in heterogeneous image matching of visible light and infrared images, a deep learning matching algorithm based on improved SuperPoint and linear transformer is proposed. The algorithm first introduces the idea of feature pyramid to construct a feature description branch based on the SuperPoint network structure, and trains it based on the hinge loss function, so as to better learn the multi-scale deep features of visible light and infrared images and increase the similarity of image point pair descriptors with the same name; in the feature matching module, the linear transformer is used to improve the SuperGlue matching algorithm and aggregate features to improve matching performance. The proposed algorithm is experimentally verified on multiple data sets. The results show that compared with the existing algorithms, the algorithm achieves better matching results and improves the matching accuracy.