TY - JOUR
T1 - ⊥-loss: A symmetric loss function for magnetic resonance imaging reconstruction and image registration with deep learning
AU - Terpstra, Maarten
AU - Maspero, Matteo
AU - Sbrizzi, Alessandro
AU - van den Berg, CAT
N1 - Funding Information:
This work is part of the research program HTSM with project number 15354, which is (partly) financed by the Netherlands Organisation for Scientific Research (NWO) and Philips Healthcare. We gratefully acknowledge the support of NVIDIA Corporation with the donation of the Quadro RTX 5000 GPU used for prototyping this research.
Publisher Copyright:
© 2022 The Authors
PY - 2022/8
Y1 - 2022/8
N2 - Convolutional neural networks (CNNs) are increasingly adopted in medical imaging, e.g., to reconstruct high-quality images from undersampled magnetic resonance imaging (MRI) acquisitions or estimate subject motion during an examination. MRI is naturally acquired in the complex domain C, obtaining magnitude and phase information in k-space. However, CNNs in complex regression tasks are almost exclusively trained to minimize the L2 loss or maximizing the magnitude structural similarity (SSIM), which are possibly not optimal as they do not take full advantage of the magnitude and phase information present in the complex domain. This work identifies that minimizing the L2 loss in the complex field has an asymmetry in the magnitude/phase loss landscape and is biased, underestimating the reconstructed magnitude. To resolve this, we propose a new loss function for regression in the complex domain called ⊥-loss, which adds a novel phase term to established magnitude loss functions, e.g., L2 or SSIM. We show ⊥-loss is symmetric in the magnitude/phase domain and has favourable properties when applied to regression in the complex domain. Specifically, we evaluate the ⊥+ℓ
2-loss and ⊥+SSIM-loss for complex undersampled MR image reconstruction tasks and MR image registration tasks. We show that training a model to minimize the ⊥+ℓ
2-loss outperforms models trained to minimize the L2 loss and results in similar performance compared to models trained to maximize the magnitude SSIM while offering high-quality phase reconstruction. Moreover, ⊥-loss is defined in R
n, and we apply the loss function to the R
2 domain by learning 2D deformation vector fields for image registration. We show that a model trained to minimize the ⊥+ℓ
2-loss outperforms models trained to minimize the end-point error loss.
AB - Convolutional neural networks (CNNs) are increasingly adopted in medical imaging, e.g., to reconstruct high-quality images from undersampled magnetic resonance imaging (MRI) acquisitions or estimate subject motion during an examination. MRI is naturally acquired in the complex domain C, obtaining magnitude and phase information in k-space. However, CNNs in complex regression tasks are almost exclusively trained to minimize the L2 loss or maximizing the magnitude structural similarity (SSIM), which are possibly not optimal as they do not take full advantage of the magnitude and phase information present in the complex domain. This work identifies that minimizing the L2 loss in the complex field has an asymmetry in the magnitude/phase loss landscape and is biased, underestimating the reconstructed magnitude. To resolve this, we propose a new loss function for regression in the complex domain called ⊥-loss, which adds a novel phase term to established magnitude loss functions, e.g., L2 or SSIM. We show ⊥-loss is symmetric in the magnitude/phase domain and has favourable properties when applied to regression in the complex domain. Specifically, we evaluate the ⊥+ℓ
2-loss and ⊥+SSIM-loss for complex undersampled MR image reconstruction tasks and MR image registration tasks. We show that training a model to minimize the ⊥+ℓ
2-loss outperforms models trained to minimize the L2 loss and results in similar performance compared to models trained to maximize the magnitude SSIM while offering high-quality phase reconstruction. Moreover, ⊥-loss is defined in R
n, and we apply the loss function to the R
2 domain by learning 2D deformation vector fields for image registration. We show that a model trained to minimize the ⊥+ℓ
2-loss outperforms models trained to minimize the end-point error loss.
KW - Artificial intelligence
KW - Complex number
KW - Deep learning
KW - Image reconstruction
KW - Loss function
KW - MRI
KW - Motion estimation
KW - Optimization
KW - Symmetry
UR - http://www.scopus.com/inward/record.url?scp=85131933131&partnerID=8YFLogxK
U2 - 10.1016/j.media.2022.102509
DO - 10.1016/j.media.2022.102509
M3 - Article
SN - 1361-8415
VL - 80
SP - 1
EP - 11
JO - Medical Image Analysis
JF - Medical Image Analysis
M1 - 102509
ER -