Unsupervised Medical Image Translation With Adversarial Diffusion Models

By Muzaffer Ozbey, S. Dar, H. Bedel, Onat Dalmaz, cSaban Ozturk, Alper Gungor, Tolga cCukur. IEEE Transactions on Medical Imaging, 2022

514 citations recorded by the source corpus.

Imputation of missing images via source-to-target modality translation can improve diversity in medical imaging protocols. A pervasive approach for synthesizing target images involves one-shot mapping through generative adversarial networks (GAN). Yet, GAN models that implicitly characterize the image distribution can suffer from limited sample fidelity. Here, we propose a novel method based on adversarial diffusion modeling, SynDiff, for improved performance in medical image translation. To capture a direct correlate of the image distribution, SynDiff leverages a conditional diffusion process that progressively maps noise and source images onto the target image. For fast and accurate image sampling during inference, large diffusion steps are taken with adversarial projections in the reverse diffusion direction. To enable training on unpaired datasets, a cycle-consistent architecture is devised with coupled diffusive and non-diffusive modules that bilaterally translate between two modalities. Extensive assessments are reported on the utility of SynDiff against competing GAN and diffusion models in multi-contrast MRI and MRI-CT translation. Our demonstrations indicate that SynDiff offers quantitatively and qualitatively superior performance against competing baselines.

Subfields: Computer Vision and Pattern Recognition, Statistical and Nonlinear Physics

View Paper: https://www.semanticscholar.org/paper/f9583f36414287bd4b7f34a9b178aa9cc3cd471a

How researchers see this paper

The researchers whose trusted networks rank it highest, strongest advocate first. Every researcher gets a different order.

In Computer Vision and Pattern Recognition

  1. Runsheng Xu
  2. Bin Cui
  3. Reza Azad
  4. Dorit Merhof
  5. Ehsan Khodapanah Aghdam
  6. Yue Zhao
  7. Moein Heidari
  8. Ming-Hsuan Yang

In Statistical and Nonlinear Physics

  1. Ehsan Khodapanah Aghdam
  2. Bin Cui
  3. Yue Zhao
  4. Moein Heidari
  5. Ming-Hsuan Yang
  6. Dorit Merhof
  7. Reza Azad
  8. Ilker Hacihaliloglu

Citations in the corpus