Spot the Fake Lungs: Generating Synthetic Medical Images Using Neural Diffusion Models

Hazrat Ali*, Shafaq Murad, Zubair Shah

*Corresponding author for this work

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

17 Citations (Scopus)

Abstract

Generative models are becoming popular for the synthesis of medical images. Recently, neural diffusion models have demonstrated the potential to generate photo-realistic images of objects. However, their potential to generate medical images is not explored yet. We explore the possibilities of synthesizing medical images using neural diffusion models. First, we use a pre-trained DALLE2 model to generate lungs X-Ray and CT images from an input text prompt. Second, we train a stable diffusion model with 3165 X-Ray images and generate synthetic images. We evaluate the synthetic image data through a qualitative analysis where two independent radiologists label randomly chosen samples from the generated data as real, fake, or unsure. Results demonstrate that images generated with the diffusion model can translate characteristics that are otherwise very specific to certain medical conditions in chest X-Ray or CT images. Careful tuning of the model can be very promising. To the best of our knowledge, this is the first attempt to generate lungs X-Ray and CT images using neural diffusion models. This work aims to introduce a new dimension in artificial intelligence for medical imaging. Given that this is a new topic, the paper will serve as an introduction and motivation for the research community to explore the potential of diffusion models for medical image synthesis. We have released the synthetic images on https://www.kaggle.com/datasets/hazrat/awesomelungs.

Original languageEnglish
Title of host publicationArtificial Intelligence and Cognitive Science - 30th Irish Conference, AICS 2022, Revised Selected Papers
EditorsLuca Longo, Ruairi O’Reilly
PublisherSpringer Science and Business Media Deutschland GmbH
Pages32-39
Number of pages8
ISBN (Print)9783031264375
DOIs
Publication statusPublished - 2023
Event30th Irish Conference on Artificial Intelligence and Cognitive Science, AICS 2022 - Munster, Ireland
Duration: 8 Dec 20229 Dec 2022

Publication series

NameCommunications in Computer and Information Science
Volume1662 CCIS
ISSN (Print)1865-0929
ISSN (Electronic)1865-0937

Conference

Conference30th Irish Conference on Artificial Intelligence and Cognitive Science, AICS 2022
Country/TerritoryIreland
CityMunster
Period8/12/229/12/22

Keywords

  • Artificial intelligence
  • CT
  • Diffusion models
  • Generative models
  • Lungs
  • Medical imaging
  • X-ray

Fingerprint

Dive into the research topics of 'Spot the Fake Lungs: Generating Synthetic Medical Images Using Neural Diffusion Models'. Together they form a unique fingerprint.

Cite this