Clinical Scorecard: A Comprehensive Review of Multimodal Human-Computer Interaction Techniques in Interventional Radiology and Surgical Procedures
At a Glance
Category
Detail
Condition
Challenges in human-computer interaction within sterile and instrument-occupied medical environments
Key Mechanisms
Use of multimodal (MM) human-computer interaction (HCI) techniques combining multiple input and output modalities (visual, auditory, haptic) to enable natural, flexible, and touchless interaction
Target Population
Medical professionals performing interventional radiology and surgical procedures
Care Setting
Sterile operating rooms and interventional suites where conventional input devices are limited
Key Highlights
Multimodal interfaces provide flexibility by combining several input modalities, allowing alternative channels when one is occupied.
Systematic literature review identified 31 relevant publications from 2013 to 2024 focusing on MM HCI in surgical and radiological contexts.
Common output modalities include visual, auditory, and haptic channels to support interaction beyond single sensory modes.
Guideline-Based Recommendations
Diagnosis
Consider the clinical task and environment constraints when selecting HCI modalities for interventional procedures.
Management
Implement multimodal input systems that allow touchless interaction to maintain sterility and accommodate instrument handling.
Combine multiple input modalities to enhance natural interaction and provide fallback options if one modality is unavailable.
Monitoring & Follow-up
Evaluate system usability and effectiveness through clinical task-based assessments and iterative feedback.
Risks
Potential challenges include modality interference, user cognitive load, and integration complexity in clinical workflows.
Patient & Prescribing Data
Not applicable (focus on clinician interaction with computer systems during procedures)
Multimodal HCI systems aim to improve clinician efficiency and safety during interventions by enabling intuitive and sterile interaction.
Clinical Best Practices
Use systematic literature review methods (e.g., PRISMA) to identify relevant multimodal HCI technologies for clinical use.
Apply multimodal input modalities tailored to specific surgical and radiological tasks to optimize interaction.
Incorporate multimodal outputs (visual, auditory, haptic) to enhance user feedback and situational awareness.
Engage multidisciplinary teams to evaluate and refine HCI systems in real clinical scenarios.
