Clinical Report: Evaluation of Large Language Models for Summarizing Health Care Experiences

Overview

This study evaluates the use of Large Language Models (LLMs) to summarize spoken narratives of health care experiences, particularly from the African American population. It examines the ability of LLMs to identify underlying topics and provide summaries.

Background

Storytelling in health care can convey personal experiences and insights that may not be captured through traditional data collection methods. Analyzing spoken narratives presents challenges due to their length and complexity. The application of LLMs in this context may enhance understanding of health care experiences.

Data Highlights

No numerical data or trial results were provided in the source material.

Key Findings

• LLMs can summarize long-form spoken narratives effectively.
• The study focuses on narratives from the African American population.
• LLMs excel in identifying topics within complex spoken dialogues.
• Utilizing NLP techniques can reveal factors contributing to gaps in health care delivery systems.
• The storytelling approach may improve communication in health care settings.

Clinical Implications

The findings suggest that LLMs can be a valuable tool for analyzing patient narratives, potentially leading to improved understanding of health care experiences. This could inform interventions aimed at addressing health disparities.

Conclusion

The evaluation of LLMs for summarizing health care narratives demonstrates their capabilities in analyzing complex spoken data.

Related Resources & Content

1. npj Digital Medicine, 2025 -- Evaluating clinical AI summaries with large language models as judges
2. npj Digital Medicine, 2026 -- Enhanced Transferability of Predictions from Electronic Health Records Across Different Countries and Coding Frameworks Using Large Language Models
3. npj Digital Medicine, 2026 -- Collaboration Between Humans and Large Language Models in Clinical Practice: A Systematic Review and Meta-Analysis
4. npj Digital Medicine, 2025 -- The evaluation illusion of large language models in medicine
5. HHS Finalizes Rule to Advance Health IT Interoperability and Algorithm Transparency - ONC - Office of the National Coordinator for Health Information Technology
6. FDA Issues Comprehensive Draft Guidance for Developers of Artificial Intelligence-Enabled Medical Devices | FDA
7. AMA adopts new policy aimed at ensuring transparency in AI tools | American Medical Association
8. Topic-aware Large Language Models for Summarizing the Lived Healthcare Experiences Described in Health Stories
9. HHS Finalizes Rule to Advance Health IT Interoperability and Algorithm Transparency - ONC - Office of the National Coordinator for Health Information Technology
10. FDA Issues Comprehensive Draft Guidance for Developers of Artificial Intelligence-Enabled Medical Devices | FDA
11. AMA adopts new policy aimed at ensuring transparency in AI tools | American Medical Association
12. Ambient AI Scribes in Clinical Practice: A Randomized Trial - PMC
13. How Large Language Models Can Affect Clinical Reasoning: A Randomized Clinical Trial | medRxiv
14. Effectiveness of large language models in preoperative and discharge education: a systematic review based on an evaluation framework | npj Digital Medicine
15. Large Language Models with Temporal Reasoning for Longitudinal Clinical Summarization and Prediction - PMC
16. LLM-assisted systematic review of large language models in clinical medicine - PMC