Multimodal analysis of whole slide images in colorectal cancer - Scorecard - MDSpire

Multimodal analysis of whole slide images in colorectal cancer

  • By

  • Jitendra Jonnagaddala

  • Miljana Shulajkovska

  • Anton Gradišek

  • Toni Rose Jue

  • Qifeng Zhou

  • Yuzhi Guo

  • Jamil Mahmoud El Chayeb

  • Ruijiang Li

  • Jana Lipkova

  • Jakob Nikolas Kather

  • Junzhou Huang

  • November 24, 2025

  • 0 min

Share

Clinical Scorecard: Comprehensive Evaluation of Whole Slide Imaging Techniques in Colorectal Cancer

At a Glance

CategoryDetail
ConditionColorectal Cancer (CRC)
Key MechanismsIntegration of whole slide imaging (WSI) with multimodal data including clinical, genomic, and radiological information to enhance diagnosis, prognosis, and treatment planning
Target PopulationPatients with colorectal cancer undergoing diagnostic and prognostic evaluation
Care SettingPathology and oncology clinical settings utilizing digital pathology and AI-based multimodal models

Key Highlights

  • Multimodal AI models combining WSIs with clinical, genomic, and radiological data improve diagnostic accuracy and survival prediction in CRC compared to unimodal models.
  • Fusion techniques (early, intermediate, late) are employed to integrate heterogeneous data modalities, enhancing feature extraction and model performance.
  • Challenges remain including data heterogeneity, lack of external validation, temporal alignment, modality weighting, and interpretability of multimodal models.

Guideline-Based Recommendations

Diagnosis

  • Use histopathological assessment of WSIs as the gold standard for CRC diagnosis.
  • Incorporate multimodal data integration (clinical, genomic, radiology) to improve diagnostic accuracy.

Management

  • Apply multimodal AI models to predict survival outcomes and therapy response for personalized treatment planning.
  • Utilize biomarker prediction from integrated data to guide precision medicine approaches.

Monitoring & Follow-up

  • Monitor model performance and validate multimodal approaches externally to ensure generalizability.
  • Address data heterogeneity and temporal alignment in longitudinal patient monitoring.

Risks

  • Be aware of potential biases due to lack of external validation in most studies.
  • Consider challenges in interpretability and modality weighting that may affect clinical decision-making.

Patient & Prescribing Data

Colorectal cancer patients undergoing diagnostic evaluation and treatment planning

Multimodal models integrating WSIs with other data modalities provide enhanced prognostic and predictive insights to inform personalized therapies and improve outcomes.

Clinical Best Practices

  • Employ multimodal fusion techniques to leverage complementary information from histopathology, genomics, and radiology.
  • Ensure rigorous external validation of AI models before clinical implementation.
  • Address challenges of data heterogeneity and model interpretability to facilitate clinical adoption.
  • Use multimodal approaches to simultaneously address multiple clinical objectives such as classification, survival prognosis, and therapy response.

References

Original Source(s)

Related Content