Dual-view fusion of log-mel spectrogram encodings for dysarthria detection: use in the context of awake brain surgery - Report - MDSpire

Dual-view fusion of log-mel spectrogram encodings for dysarthria detection: use in the context of awake brain surgery

  • By

  • Nassib Abdallah

  • Harrison Misy

  • Jean-Marie Marion

  • Chinmayi Kanthila

  • Celine Panheleux

  • Vanessa Saliou

  • Romuald Seizeur

  • Guillaume Dardenne

  • July 10, 2026

  • 0 min

Share

Integration of Dual-View Log-Mel Spectrogram Features for Detecting Dysarthria

Overview

This study investigates the effectiveness of dual-view log-mel spectrogram features for detecting dysarthria during awake brain surgery. It explores the performance of adaptive fusion strategies, including attention and gating, compared to traditional methods in challenging intraoperative conditions.

Background

Dysarthria, a speech disorder resulting from various neurological conditions, poses significant challenges during awake craniotomy procedures. Accurate detection of dysarthria is crucial for preserving language and speech functions during surgery. Current methods rely heavily on expert judgment, which can be cognitively demanding and variable.

Data Highlights

No numerical data or trial data provided in the source material.

Key Findings

  • Combining dual-view log-mel spectrogram features improves dysarthria detection compared to unimodal representations.
  • Adaptive fusion strategies, such as attention and gating, outperform simple feature concatenation in noisy speech data.
  • Stability and data sensitivity of fusion mechanisms vary, particularly in small and heterogeneous clinical cohorts.
  • Robustness of models under severe domain shift is critical for generalization from controlled to intraoperative speech recordings.
  • Current automated detection methods face challenges due to acoustic variability and transient impairments in speech.

Clinical Implications

The findings indicate that integrating multimodal spectrotemporal features could enhance dysarthria detection in clinical settings.

Conclusion

The study highlights the potential of advanced deep learning techniques in improving dysarthria detection during awake brain surgery.

Related Resources & Content

  1. Intraoperative Use of nTMS, CCEPs, and DCS for Language Assessment: A Look Ahead to Future Developments, 2025 -- https://link.springer.com/article/10.1007/s00701-025-06691-5
  2. Localization of Language Functions in Subcortical Areas During Awake Craniotomy for Resection of Dominant Posterior Temporal Glioma in a Patient with Hearing Impairment, 2023 -- https://link.springer.com/article/10.1007/s00701-023-05586-7
  3. Detection of Surgical Events Using Audio Analysis in the Operating Room, 2024 -- https://link.springer.com/article/10.1007/s11548-024-03211-1
  4. Guidelines for Awake Surgery - PMC, 2023 -- https://pmc.ncbi.nlm.nih.gov/articles/PMC10835579/?utm_source=openai
  5. Awake Craniotomy Versus General Anesthesia for Resection of High-Grade Gliomas: A Systematic Review and Meta-Analysis, 2026 -- https://www.mdpi.com/2077-0383/15/4/1431?utm_source=openai
  6. Intraoperative Use of nTMS, CCEPs, and DCS for Language Assessment: A Look Ahead to Future Developments
  7. Localization of Language Functions in Subcortical Areas During Awake Craniotomy for Resection of Dominant Posterior Temporal Glioma in a Patient with Hearing Impairment
  8. Detection of Surgical Events Using Audio Analysis in the Operating Room
  9. Selective transient aphasia induced by electrical stimulation of the left superior temporal gyrus in highly skilled bilingual individuals
  10. Dysarthria in Adults
  11. Guidelines for Awake Surgery - PMC
  12. Awake Craniotomy Versus General Anesthesia for Resection of High-Grade Gliomas: A Systematic Review and Meta-Analysis

Original Source(s)

Related Content