Radiologists Tested on AI X-Rays - Report - MDSpire

Radiologists Tested on AI X-Rays

  • By

  • Doug Brunk

  • April 1, 2026

  • 4 min

Share

Clinical Report: Radiologists Tested on AI X-Rays

Overview

A recent study found that radiologists could distinguish AI-generated radiographs from real images with 75% accuracy. The study highlights the challenges posed by increasingly realistic synthetic medical images and the need for improved detection strategies.

Background

The integration of artificial intelligence (AI) in radiology has surged, raising concerns about the ability of radiologists to identify synthetic images. As AI-generated images become more sophisticated, understanding their impact on diagnostic accuracy is crucial for patient safety and clinical integrity. This study provides insights into the current capabilities and limitations of radiologists in detecting AI-generated radiographs.

Data Highlights

{'Phase 1': "Specify accuracy if available or state 'Not specified' clearly."}

Key Findings

  • Radiologists achieved 75% accuracy in distinguishing synthetic from real radiographs.
  • Diagnostic accuracy for identifying abnormalities was high for both synthetic (92%) and real images (91%).
  • 41% of radiologists recognized AI-generated images when initially unaware of their presence.
  • Experience did not significantly affect detection performance, although musculoskeletal radiologists performed better (83% accuracy).
  • Common features of synthetic images included excessive symmetry and uniform noise patterns.
  • None of the tested LLMs identified all synthetic radiographs, with GPT-4o achieving 85% accuracy.

Clinical Implications

The findings underscore the need for enhanced training for radiologists to recognize AI-generated images and the implementation of technical safeguards. Strategies such as watermarking and provenance tracking may help mitigate risks associated with synthetic medical images in clinical practice.

Conclusion

As AI technology continues to evolve, it is imperative for healthcare professionals to remain vigilant in distinguishing synthetic images from authentic ones. Ongoing education and technical innovations will be essential in maintaining diagnostic accuracy.

References

  1. European Radiology, 2023 -- The Impact of Erroneous AI Outcomes on Radiologists: Insights from a Multi-Reader Pilot Study on Lung Cancer Detection via Chest Radiography
  2. European Radiology, 2023 -- Key Insights on AI Utilization in Breast Imaging: Guidelines from the European Society of Breast Imaging
  3. European Radiology, 2023 -- Embracing Artificial Intelligence in Radiology: Balancing Its Potential Benefits with Current Limitations in Clinical Practice
  4. European Radiology, 2023 -- A Comprehensive Guide to the Role of Artificial Intelligence in Thoracic Imaging: Insights from the European Society of Thoracic Imaging (ESTI)
  5. RSNA, 2026 -- ChatGPT Generated Radiographs Fool Radiologists
  6. FDA, 2025 -- Marketing Submission Recommendations for a Predetermined Change Control Plan for Artificial Intelligence-Enabled Device Software Functions
  7. ChatGPT Generated Radiographs Fool Radiologists | RSNA
  8. Marketing Submission Recommendations for a Predetermined Change Control Plan for Artificial Intelligence-Enabled Device Software Functions | FDA
  9. https://notjonhuang.github.io/papers/jno2025/paper1.pdf

Original Source(s)

Related Content