To address methodological considerations regarding the reference standard used in AI-assisted cystoscopic diagnosis.
Approach:
Key Findings:
Cystoscopic impression alone has limitations, with studies showing low reliability in distinguishing between lesion grades.
Carcinoma in situ (CIS) is often missed under white light cystoscopy, highlighting the need for improved diagnostic methods.
Histopathological confirmation is widely accepted as the reference standard in AI-assisted cystoscopy literature.
Interpretation:
The authors emphasize the importance of a reliable reference standard for evaluating AI models in cystoscopy, advocating for a tiered approach to enhance diagnostic accuracy.
Limitations:
Logistical challenges in obtaining histopathology for every image in large datasets.
Visual consensus may not provide sufficient diagnostic certainty for certain lesion categories.
Conclusion:
Future benchmarking studies should implement a tiered reference framework to improve the evaluation of AI in cystoscopy.