AI Outperforms MDs on Reasoning Tasks - Takeaways - MDSpire
From the Journals

AI Outperforms MDs on Reasoning Tasks

Across six experiments—including a blinded, real-world ER evaluation—an OpenAI large language model outperformed physician baselines on multiple clinical reasoning tasks, though not on key safety endpoints such as cannot-miss diagnoses

Share

  • 1

    Study by Peter G. Brodeur, MD, and colleagues on AI in diagnostics.

  • 2

    OpenAI's o1 model outperformed human physicians in emergency cases.

  • 3

    Accurate diagnoses: 67%-82% for o1 vs. 50%-70% for physicians.

  • 4

    NEJM CPC cases saw 78% diagnosis inclusion by o

  • 5

    Limitations include focus on text inputs and lack of imaging or examination assessments.

  • 6

    Future research needed for AI impact on clinical practice.

  • 7

    Funding from NIH, Harvard Medical School, and others.

Original Source(s)

AI Outperforms MDs on Reasoning Tasks

  • by Kerri Miller

  • May 4, 2026

Related Content

Pharma Supply Chains in the Crossfire

How tariff uncertainty and geopolitical tensions are reshaping pharmaceutical logistics

  • May 5, 2026

  • 8 min
FDA Cleared ≠ FDA Validated

Most AI medical devices reach the market without independent evidence of safety or effectiveness.

Food Fight Brewing in Hospitals

New federal diet push collides with clinical realities, as doctors weigh patient needs against policy signals.