Can AI Aid Urine Drug Test Sign-Outs? - Summary - MDSpire
Advertisement
Can AI Aid Urine Drug Test Sign-Outs?
Researchers reported that an artificial intelligence workflow maintained high interpretive accuracy while reducing urine drug test sign-out time in a supervised clinical laboratory setting.
To evaluate the accuracy and efficiency of an AI system in generating preliminary interpretations of urine drug tests.
Approach:
Study Design: The study analyzed 83,553 urine drug tests from 26,459 patients at the University of Washington Medical Center from January 2014 to February 2024.
AI Workflow Development: Large language models (LLM) were used to extract substance-use labels from historical interpretations, training machine learning models to predict substance use from test results.
Evaluation Metrics: Primary outcomes included accuracy of label extraction, substance-use prediction, and AI-generated interpretations, while secondary outcomes focused on clinician modifications and adoption rates.
Machine learning models predicted substance use with an AUC greater than 0.99 for 23 of 26 substances, with accuracy exceeding 94%.
AI integration reduced average sign-out time by 28.5 seconds per case (23% efficiency gain) and by 65 seconds with an automated medication-list feature (51% efficiency gain).
70% of AI-generated interpretations required no substantive changes, while 4% prompted overrides due to incorrect classifications.
Interpretation:
Limitations:
Retrospective, single-center design.
Lack of protocol preregistration.
Relatively small postdeployment validation samples.
A VHA study across 11 vendors finds AI-generated primary care notes score lower than clinician-written notes, with the largest deficits in thoroughness, organization, and usefulness