Publications

Improving end-to-end speech recognition for dysarthric speech through in-domain data augmentation

Abstract

Dysarthric speech recognition is crucial for facilitating effective communication among individuals with dysarthria. However, accurately recognizing dysarthric speech poses significant challenges due to varying severity levels and limited data availability. In this paper, we explore data augmentation techniques for dysarthric automatic speech recognition (ASR) systems by fine-tuning the End-to-End pre-trained Wav2Vec2 model, with a specific focus on severity levels. To address the challenges of data scarcity and the need for extensive data in fine-tuning pre-trained ASR systems for dysarthric speech, we investigate four prominent data augmentation methods: Speaking-Rate Modification (SRM), Pitch Modification (PM), Formant Modification (FM), and vocal tract Length Perturbation (VTLP), tailored to different aspects of dysarthria. The study uses individually fine-tuned Wav2Vec2 models for each severity class as …

Metadata

publication
2024 58th Asilomar Conference on Signals, Systems, and Computers, 345-349, 2024
year
2024
publication date
2024/10/27
authors
Paban Sapkota, Hemant Kumar Kathania, Sudarsana Reddy Kadiri, Shrikanth Narayanan
link
https://ieeexplore.ieee.org/abstract/document/10942692/
conference
2024 58th Asilomar Conference on Signals, Systems, and Computers
pages
345-349
publisher
IEEE