Clinical Report: External Validity of Task-Specific Metrics in Laparoscopic Crural Repair

Overview

This study evaluated the external validity of previously developed task-specific metrics (TSMs) for assessing laparoscopic crural repair performance using a simulated model. The TSMs demonstrated good reliability and discriminant validity across a diverse cohort of international and U.S.-based surgeons and trainees, supporting their broader applicability in simulation-based surgical training.

Background

Gastroesophageal reflux disease (GERD) is commonly associated with hiatal hernias, which disrupt the anti-reflux barrier formed by the lower esophageal sphincter and diaphragmatic crura. Surgical correction involves crural closure and fundoplication, procedures requiring significant technical skill and experience. Simulation-based training with validated assessment tools is critical to safely develop these skills. Previously, task-specific metrics (TSMs) were developed and validated at a single U.S. institution to assess laparoscopic crural repair performance in simulation, but their external validity remained untested.

Data Highlights

Key Findings

• TSMs were developed through hierarchical task analysis and validated initially at a single U.S. institution with 33 participants stratified by experience.
• In the current study, 30 surgeons and trainees from both U.S. and international backgrounds performed simulated crural repairs using a standardized silicone model.
• Video-based assessments using TSMs and OSATS showed good to excellent inter-rater reliability (ICC > 0.75).
• TSMs effectively discriminated between novice and experienced participants, confirming their construct validity in a diverse cohort.
• Participants reported favorable perceptions of the simulator’s realism and utility, supporting its use in training environments.
• The study supports the external validity and reliability of TSMs for assessing laparoscopic crural repair performance in simulation beyond the initial development site.

Clinical Implications

Validated task-specific metrics provide a reliable and objective method to assess surgical performance in laparoscopic crural repair simulation. Their demonstrated external validity supports their integration into surgical training curricula internationally, facilitating standardized feedback and potentially accelerating the learning curve. Adoption of such metrics can enhance competency-based education and improve patient safety by ensuring technical proficiency before clinical practice.

Conclusion

The study confirms that task-specific metrics for laparoscopic crural repair are externally valid and reliable across diverse surgical populations. These findings endorse their broader application in simulation-based training to improve surgical skill acquisition and assessment.

References

1. Society of American Gastrointestinal and Endoscopic Surgeons (SAGES) 2024 -- Video-based assessment tool for laparoscopic fundoplication
2. UT Southwestern Medical Center 2023 -- Development and validation of task-specific metrics for laparoscopic crural repair
3. NASA Task Load Index (NASA-TLX) 1988 -- Cognitive load assessment tool