Publications
Improving end-to-end speech recognition for dysarthric speech through in-domain data augmentation
Abstract
Dysarthric speech recognition is crucial for facilitating effective communication among individuals with dysarthria. However, accurately recognizing dysarthric speech poses significant challenges due to varying severity levels and limited data availability. In this paper, we explore data augmentation techniques for dysarthric automatic speech recognition (ASR) systems by fine-tuning the End-to-End pre-trained Wav2Vec2 model, with a specific focus on severity levels. To address the challenges of data scarcity and the need for extensive data in fine-tuning pre-trained ASR systems for dysarthric speech, we investigate four prominent data augmentation methods: Speaking-Rate Modification (SRM), Pitch Modification (PM), Formant Modification (FM), and vocal tract Length Perturbation (VTLP), tailored to different aspects of dysarthria. The study uses individually fine-tuned Wav2Vec2 models for each severity class as …
Metadata
- publication
- 2024 58th Asilomar Conference on Signals, Systems, and Computers, 345-349, 2024
- year
- 2024
- publication date
- 2024/10/27
- authors
- Paban Sapkota, Hemant Kumar Kathania, Sudarsana Reddy Kadiri, Shrikanth Narayanan
- link
- https://ieeexplore.ieee.org/abstract/document/10942692/
- conference
- 2024 58th Asilomar Conference on Signals, Systems, and Computers
- pages
- 345-349
- publisher
- IEEE