An Improved Receptive Fields Network for Matching Remote Sensing Images

Volume 6, Issue 2, April 2022     |     PP. 58-68      |     PDF (465 K)    |     Pub. Date: August 7, 2022
DOI: 10.54647/geosciences17182    88 Downloads     85517 Views  

Author(s)

Wannan Zhang, School of Computer, Central South University, China.

Abstract
We present a new network combining Residual Network (ResNet) and Receptive Fields Network (RF-Net) for matching remote sensing images. Firstly, a new remote sensing image datasets are setup, which consist of images and homograph matrices. The images are obtained by cropping, illumination changing and affine transforming of the original remote sensing images. The matrices are obtained by calculating the homograph between different images of one sequence. Next, a dual-channel network structure is proposed for keypoints detection. The network consists of Receptive Fields Detection (RF-Det) and ResNet for extracting receptive feature maps with detail information and the deep layer maps with semantic information. Then descriptors of these keypoints are generated using a L2-Net. Finally, the strategies of the nearest neighbor, nearest neighbor with a threshold and nearest neighbor distance ratio are used for matching descriptors. Experimental results demonstrate its superior matching performance with respect to the original RF-Net.

Keywords
Remote sensing images, Registration, ResNet, RF-Net.

Cite this paper
Wannan Zhang, An Improved Receptive Fields Network for Matching Remote Sensing Images , SCIREA Journal of Geosciences. Volume 6, Issue 2, April 2022 | PP. 58-68. 10.54647/geosciences17182

References

[ 1 ] Barbara Zitová, Flusser J . Image Registration Methods: A Survey[J]. Image and Vision Computing, 2003, 21(11):977-1000.
[ 2 ] Ono Y , Trulls E , Fua P , et al, “LF-Net: Learning Local Features from Images”, 2018.
[ 3 ] Yi K M , Trulls E , Lepetit V , et al. LIFT: Learned Invariant Feature Transform[C]// European Conference on Computer Vision. Springer, Cham, 2016.
[ 4 ] Lowe D G . Distinctive Image Features from Scale-Invariant Keypoints[J]. International Journal of Computer Vision, 2004, 60(2):91-110.
[ 5 ] A P Y , A Y T , A Y T , et al. Unsupervised Learning Framework for Interest Point Detection and Description via Properties Optimization[J]. Pattern Recognition, 2021.
[ 6 ] Li M , Wang Y . An Energy-Efficient Silicon Photonic-Assisted Deep Learning Accelerator for Big Data[J]. Wireless Communications and Mobile Computing, 2020, 2020:1-11.
[ 7 ] Chopra S , Hadsell R , Lecun Y . Learning a similarity metric discriminatively, with application to face verification[C]// 2005 IEEE Computer Society Conference on Computer Vision and Pattern Recognition (CVPR'05). IEEE, 2005.
[ 8 ] Shen X , Wang C , Li X , et al. RF-Net: An End-To-End Image Matching Network Based on Receptive Field[C]// 2019 IEEE/CVF Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 2019..
[ 9 ] Wang S , Guo X , Tie Y , et al. Local Feature Descriptor Learning with a Dual Hard Sampling Strategy[C]// 2019 IEEE International Symposium on Multimedia (ISM). IEEE, 2020.
[ 10 ] He K , Zhang X , Ren S , et al. Deep Residual Learning for Image Recognition[C]// IEEE Conference on Computer Vision & Pattern Recognition. IEEE Computer Society, 2016.
[ 11 ] Katz G , Barrett C , Dill D , et al. Reluplex: An Efficient SMT Solver for Verifying Deep Neural Networks[C]// International Conference on Computer Aided Verification. 2017.
[ 12 ] Gulcehre C , Cho K , Pascanu R , et al. Learned-Norm Pooling for Deep Feedforward and Recurrent Neural Networks[C]// Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer Berlin Heidelberg, 2014.
[ 13 ] Gulcehre C , Cho K , Pascanu R , et al. Learned-Norm Pooling for Deep Feedforward and Recurrent Neural Networks[C]// Joint European Conference on Machine Learning and Knowledge Discovery in Databases. Springer Berlin Heidelberg, 2014.
[ 14 ] Zhao X , Li W , Zhang Y , et al. Aggregated Residual Dilation Based Feature Pyramid Network for Object Detection[J]. IEEE Access, 2019, PP(99):1-1.
[ 15 ] MIKOLAJCZYK K,SCHMID C. A performance evaluation of local descriptors[J]. IEEE Transactions on Pattern Analysis and Machine Intelligence, 2005, 27(10):1615-1630.
[ 16 ] Kingma D , Ba J . Adam: A Method for Stochastic Optimization[J]. Computer Science, 2014.