Mental health app crisis support assessment framework: development and pilot testing - Report - MDSpire

Mental health app crisis support assessment framework: development and pilot testing

  • By

  • Anastasiia Knysh

  • Taras Pohrebniak

  • June 10, 2026

  • 0 min

Share

Clinical Report: Framework for Evaluating Crisis Support in Mental Health Applications

Overview

Revise to focus solely on the introduction of MHACSAF without unsupported claims.

Background

Mental health applications are increasingly utilized as standalone interventions or adjuncts to clinical care, yet their effectiveness in supporting users during crises is not well understood. The lack of consistent standards for crisis support in these applications raises concerns about user safety, particularly for those experiencing acute psychological distress. Given the global priority of suicide prevention, it is critical to assess and enhance the crisis support capabilities of these digital tools.

Data Highlights

AppMean Total ScoreClassification
Wysa40.3Not classified
Youper36.5Not classified
Flourish30.0Not classified
Earkick25.0Not classified
Replika20.0Not classified
Ash13.0Not classified

Key Findings

  • The MHACSAF includes seven scored dimensions totaling 65 points for evaluating crisis support.
  • Inter-rater reliability among evaluators was strong (Fleiss’ kappa = 0.87).
  • Mean total scores for the evaluated apps ranged from 13.0 to 40.3, with no app achieving 'Good' or 'Excellent' classification.
  • Wysa had the highest score but still showed deficiencies in accessibility and localization.
  • Technical accessibility for users with disabilities was largely absent across all products.
  • Crisis resources were often difficult to find, with critical information sometimes linked to inaccessible external websites.

Clinical Implications

The findings indicate that mental health applications currently lack adequate crisis support features, which could jeopardize user safety during critical moments. Clinicians and developers should prioritize the integration of evidence-based crisis support features in these applications to enhance user safety.

Conclusion

The MHACSAF provides a structured approach for evaluating crisis support in mental health applications, revealing significant shortcomings in current offerings. Addressing these gaps is essential for improving user safety during psychological emergencies.

Related Resources & Content

  1. npj Digital Medicine, 2026 -- Assessing Youth Mental Health Needs Through an Adaptive Digital Tool: Findings from a Cross-Sectional Analysis
  2. Frontiers in Digital Health, 2026 -- Co-creating a program theory and evaluability assessment for an Irish single-session, synchronous chat-based youth mental health intervention: implications for outcome evaluation
  3. Frontiers in Psychiatry, 2026 -- Feasibility of smartphone app-based neuropsychological tasks for screening people with subclinical depression and anxiety: a preliminary validation study
  4. SAMHSA, 2025 -- 2025 National Guidelines for a Behavioral Health Coordinated System of Crisis Care
  5. Frontiers in Digital Health — A framework for culturally adapting mental mHealth apps
  6. 988 Suicide & Crisis Lifeline Suicide Safety Policy
  7. 988 Lifeline Minimum Standards for Crisis Contact Centers
  8. The App Evaluation Model - American Psychiatric Association
  9. 2025 National Guidelines for a Behavioral Health Coordinated System of Crisis Care
  10. NHS England » Digitally enabled therapies assessment criteria
  11. Systematic Review and Meta-Analysis: Effectiveness of Stand-Alone Digital Suicide Preventive Interventions for the Self-Management of Suicidality | Journal of Technology in Behavioral Science | Springer Nature Link
  12. Clinical effectiveness and safety of adding a self-harm prevention app (BlueIce) to specialist mental health care for adolescents who repeatedly self-harm: A single blind randomised controlled trial (the BASH study) - ScienceDirect
  13. A Digital Therapeutic Intervention for Inpatients With Elevated Suicide Risk: A Randomized Clinical Trial | Digital Health | JAMA Network Open | JAMA Network
  14. Mental Health, Brain Health and Substance Use
  15. Best Practices - 988 Lifeline
  16. Does Personalized Mean Popular? A Content Analysis of Suicide Prevention Smartphone Applications - PubMed

Original Source(s)

Related Content