Registration of high resolution SAR and optical satellite imagery using fully convolutional networks.

Hoffmann S, Brust C-A, Shadaydeh M, Denzler J (2019) Registration of high resolution SAR and optical satellite imagery using fully convolutional networks. In: IEEE International Geoscience and Remote Sensing Symposium (IGARSS) IEEE International Geoscience and Remote Sensing Symposium (IGARSS), Yokohama, Japan, 07/28/2019-08/02/2019, tba.

Abstract

Multi-modal image registration is a crucial step when fusing images which show different physical/chemical properties of an object. Depending on the compared modalities and the used registration metric, this process exhibits varying reliability. We propose a deep metric based on a fully convolutional neural network (FCN). It is trained from scratch on SAR-optical image pairs to predict whether certain image areas are aligned or not. Tests on the affine registration of SAR and optical images showing suburban areas verify an enormous improvement of the registration accuracy in comparison to registration metrics that are based on mutual information (MI).

HKI-Authors