Freely accessible large language models for parent education in pediatric immune thrombocytopenia: an expert-rated cross-sectional study of safety, readability, and guideline concordance - Report - MDSpire
Advertisement
Freely accessible large language models for parent education in pediatric immune thrombocytopenia: an expert-rated cross-sectional study of safety, readability, and guideline concordance
Clinical Report: Evaluation of Open-Access Large Language Models for Educating Parents on Pediatric Immune Thrombocytopenia
Overview
This study evaluates the quality, safety, readability, and guideline concordance of responses from large language models (LLMs) to parent-oriented questions about pediatric immune thrombocytopenia (ITP).
Background
Pediatric immune thrombocytopenia (ITP) is a common acquired bleeding disorder in children, characterized by low platelet counts. Effective communication of information regarding ITP is crucial for parents. The increasing reliance on online resources for medical information necessitates an evaluation of the quality and safety of these resources, particularly those generated by LLMs.
Data Highlights
Model
Mean Composite Score (AI-ITP-PRS)
Standard Deviation
Gemini 3 Flash
32.78
2.54
Claude Sonnet 4.6
30.60
1.39
GPT-5.3-mini
29.98
1.52
Key Findings
Significant differences in the AI-ITP-PRS scores across models (Friedman chi-square = 63.52, p < 0.001).
Gemini 3 Flash had the highest mean composite score, driven by completeness and comprehensibility.
Medical accuracy and guideline concordance were largely similar across models.
Two instances of unsafe content were identified in Gemini 3 Flash responses.
Readability was assessed using automated indices, indicating varying levels of comprehensibility.
Clinical Implications
Healthcare providers should be aware of the variability in the quality of information provided by LLMs when educating parents about pediatric ITP.
Conclusion
The study identifies areas for improvement in safety and accuracy of LLMs in providing educational content for parents of children with ITP.