Clinical AI is Not (Yet) Trustworthy-But It Could Be - Report - MDSpire

Clinical AI is Not (Yet) Trustworthy-But It Could Be

  • By

  • Ali Saad

  • Sofia B Dias

  • Ghada Alhussein

  • David Lyreskog

  • Ioannis Gerasimou

  • Beatriz Alves

  • Μaarten de Vos

  • Ioannis Drivas

  • John Zaras

  • Andreas Stergioulas

  • Iskanter Bensenousi

  • Leontios Hadjileontiadis

  • Christos Chatzichristos

  • Stelios Hadjidimitriou

  • April 29, 2026

  • 0 min

Share

Clinical Report: The Trustworthiness of Clinical AI: Current Limitations and Future Potential

Overview

This report discusses the critical importance of trustworthiness in clinical AI systems, emphasizing that performance metrics alone are insufficient. It introduces the ALTAI framework as a procedural approach to enhance trust throughout the AI lifecycle.

Background

The integration of AI in healthcare has the potential to improve diagnostic accuracy and treatment optimization. However, the cautious adoption of these technologies is largely due to concerns about their trustworthiness, which encompasses transparency, accountability, and ethical alignment. Establishing trust is essential for the successful deployment of AI systems in clinical settings.

Data Highlights

Revise to indicate the absence of numerical data but mention qualitative insights if applicable.

Key Findings

  • Trust in clinical AI is a multidimensional construct that includes ethical principles and regulatory standards.
  • The ALTAI framework provides a practical checklist for embedding trustworthiness into the AI development lifecycle.
  • AI-PROGNOSIS serves as a case study for applying the ALTAI framework, focusing on predictive models for Parkinson disease.
  • Procedural approaches to trustworthiness are necessary to bridge the implementation gap in AI systems.
  • Trust is cultivated over time through system behavior and user experience, not just through retrospective audits.

Clinical Implications

Healthcare professionals should prioritize the integration of trust-oriented safeguards in AI system development. Utilizing frameworks like ALTAI can guide the ethical and transparent deployment of AI technologies in clinical practice.

Conclusion

Establishing trustworthiness in clinical AI is vital for its successful integration into healthcare. A procedural approach, as exemplified by the ALTAI framework, can facilitate this process.

References

  1. High-Level Expert Group on AI, European Commission, 2023 -- Assessment List for Trustworthy Artificial Intelligence
  2. aace endocrine ai — Medical AI: What shapes patient trust?
  3. the asco post — Most People Trust AI Less Than Physicians, Survey Finds
  4. npj Digital Medicine — Enhancing Governance of Healthcare AI with a Detailed Maturity Model Derived from Systematic Review Findings
  5. asco ai in oncology — Survey Finds Most People Trust AI Less Than Physicians, But See Its Potential for Cancer Diagnosis
  6. Medical AI: What shapes patient trust?
  7. Most People Trust AI Less Than Physicians, Survey Finds
  8. Enhancing Governance of Healthcare AI with a Detailed Maturity Model
  9. Artificial Intelligence in healthcare - Public Health - European Commission
  10. Interval cancer, sensitivity, and specificity comparing AI-supported mammography screening with standard double reading without AI in the MASAI study: a randomised, controlled, non-inferiority, single-blinded, population-based, screening-accuracy trial - PubMed
  11. Principles to guide clinical AI readiness and move from benchmarks to real-world evaluation | Nature Medicine

Original Source(s)

Related Content