Semantic similarity metrics for image registration

Research output: Contribution to journalJournal articleResearchpeer-review


  • Fulltext

    Final published version, 4.14 MB, PDF document

Image registration aims to find geometric transformations that align images. Most algorithmic and deep learning-based methods solve the registration problem by minimizing a loss function, consisting of a similarity metric comparing the aligned images, and a regularization term ensuring smoothness of the transformation. Existing similarity metrics like Euclidean Distance or Normalized Cross-Correlation focus on aligning pixel intensity values or correlations, giving difficulties with low intensity contrast, noise, and ambiguous matching. We propose a semantic similarity metric for image registration, focusing on aligning image areas based on semantic correspondence instead. Our approach learns dataset-specific features that drive the optimization of a learning-based registration model. We train both an unsupervised approach extracting features with an auto-encoder, and a semi-supervised approach using supplemental segmentation data. We validate the semantic similarity metric using both deep-learning-based and algorithmic image registration methods. Compared to existing methods across four different image modalities and applications, the method achieves consistently high registration accuracy and smooth transformation fields.

Original languageEnglish
Article number102830
JournalMedical Image Analysis
Number of pages16
Publication statusPublished - 2023

Bibliographical note

Publisher Copyright:
© 2023 The Author(s)

    Research areas

  • Deep learning, Image registration, Representation learning

ID: 347484754