Comparison of Acoustic and Textual Features for Dysarthria Severity Classification in Amyotrophic Lateral Sclerosis

Y. S., Upendra Vishwanath; Bhattacharjee, Tanuka; G, Deekshitha; Udupa, Sathvik; Chowdam Venkata Thirumala, Kumar; Keerthipriya, Madassu; Chikktimmegowda, Darshan; Baskar, Dipti; Belur, Yamini; Vengalil, Seena; Nalini, Atchayaram; Ghosh, Prasanta Kumar

doi:10.21437/Interspeech.2025-2767

Comparison of Acoustic and Textual Features for Dysarthria Severity Classification in Amyotrophic Lateral Sclerosis

Upendra Vishwanath Y. S., Tanuka Bhattacharjee, Deekshitha G, Sathvik Udupa, Kumar Chowdam Venkata Thirumala, Madassu Keerthipriya, Darshan Chikktimmegowda, Dipti Baskar, Yamini Belur, Seena Vengalil, Atchayaram Nalini, Prasanta Kumar Ghosh

We explore language-agnostic deep text embeddings for severity classification of dysarthria in Amyotrophic Lateral Sclerosis (ALS). Speech recordings are transcribed by human and ASR and embeddings of the transcripts are considered. Though speech recognition accuracy has been studied for grading dysarthria severity, no effort has yet been made to utilize text embeddings of the transcripts. We perform severity classification at different granularity (2, 3, and 5-class) using data obtained from 47 ALS subjects. Experiments with dense neural network based classifiers suggest that, though text features achieve nearly equal performances as baseline speech features, like statistics of mel frequency cepstral coefficients (MFCC), for 2-class classification, speech features outperform for higher number of classes. Concatenation of text embeddings and MFCC statistics attains the best performances with mean F1 scores of 88%, 68%, and 53%, respectively, in 2, 3, and 5-class classification.