External validation of machine learning models for predicting prehospital delay in acute ischemic stroke: a retrospective cohort study - Report - MDSpire
Clinical Report: External Assessment of Machine Learning Algorithms for Anticipating Prehospital Delays in Acute Ischemic Stroke
Overview
This study externally validated eight prediction algorithms for prehospital delays in acute ischemic stroke (AIS) and compared their performance against logistic regression models.
Background
Acute ischemic stroke (AIS) is a leading cause of mortality and disability, with timely reperfusion therapy being critical for patient outcomes. Prehospital delays significantly hinder the administration of such therapies, making it essential to identify predictive factors.
Data Highlights
Cohort
Delay Affected (%)
Hospital 1
80.9
Hospital 2
83.2
Key Findings
Prehospital delay affected 80.9% of patients in Hospital 1 and 83.2% in Hospital 2.
The logistic regression model without SMOTE achieved an AUC of 0.774, compared to 0.756 with SMOTE.
XGBoost produced the highest validation AUC of 0.771, but the difference from logistic regression was not statistically significant (p = 0.107).
Absolute risk differences for factors such as rural residence and non-emergency-channel presentation were significant.
Complex algorithms did not consistently show improvement over simpler logistic regression models.
Clinical Implications
The findings suggest that while machine learning models can be explored for predicting prehospital delays, logistic regression remains a robust option. Clinicians should focus on modifiable factors contributing to delays to improve stroke care delivery.
Conclusion
The study highlights the need for ongoing evaluation of predictive models in stroke care.
Baptist Health will bring together leading physicians, researchers and healthcare professionals from South Florida and across the country for the 14th Annual Baptist Health Miami Neuroscience Symposium, taking place Nov. 4-6, 2026, at Hilton Miami Dadeland and virtually via Zoom.