Skip to main navigation Skip to search Skip to main content

Dysarthria Detection Based on Voice Recordings using Multiscale CNN Architecture with Temporal Pyramid Pooling

Research output: Chapter in Book/Report/Conference proceedingConference contributionpeer-review

Abstract

Dysarthria is a neurological speech disorder commonly observed in patients with multiple sclerosis, Parkinson’s disease, and stroke. Traditional diagnostic procedures rely on sebjective and time-consuming clinical evaluations, which motivates the need for automated and reliable assessment methods. however, conventional Convolutional Neural Networks (CNNs) face a fundamental limitation when processing speech recordings of varying durations, often requiring truncation or padding that leads to loss of temporal information and reduced classification performance. This study proposes a robust dysarthria detection framework based on mel-spectrogram features for binary classification, Dysarthria and Control, using the TORGO dataset. The audio signals are converted into mel-spectrogram representations, then fed into a Multiscale CNN architecture. The Multiscale CNN employs parallel convolutional branches with different receptive fields to enrich multiresolution feature extraction, while a Temporal Pyramid Pooling (TPP) layer transforms variable-length temporal features into fixed-dimensional representations, enabling the model to effectively handle recordings of diverse durations. Experimental results demonstrate that the proposed Multiscale CNN-TPP model effectively overcomes the variable-length speech problem and significantly outperforms a standard CNN baseline. The model achieves an accuracy of 97.56% and an F1-score of 97.54%, indicating enhanced spatio-temporal feature extraction and improved generalization. These findings confirm the effectiveness of integrating multiscale and temporal pooling mechanisms and provide a promising foundation for developing reliable automated tools to support early dysarthria detection.

Original languageEnglish
Title of host publication2025 1st International Conference on Data Science and Geoinformatics, ICDSG 2025
PublisherInstitute of Electrical and Electronics Engineers Inc.
Pages393-397
Number of pages5
ISBN (Electronic)9798331560973
DOIs
Publication statusPublished - 2025
Event1st International Conference on Data Science and Geoinformatics, ICDSG 2025 - Bali, Indonesia
Duration: 26 Nov 202528 Nov 2025

Publication series

Name2025 1st International Conference on Data Science and Geoinformatics, ICDSG 2025

Conference

Conference1st International Conference on Data Science and Geoinformatics, ICDSG 2025
Country/TerritoryIndonesia
CityBali
Period26/11/2528/11/25

Keywords

  • Dysarthria detection
  • multiscale convolutional neural network (Multiscale CNN)
  • speech disorder classification
  • temporal pyramid pooling (TPP)

Fingerprint

Dive into the research topics of 'Dysarthria Detection Based on Voice Recordings using Multiscale CNN Architecture with Temporal Pyramid Pooling'. Together they form a unique fingerprint.

Cite this