DistilWhisper: Efficient Distillation of Multi-task Speech Models via Language-Specific Experts
Paper • 2311.01070 • Published • 3
Multilingual DistilWhisper
Multilingual Distilwhisper allows for better ASR performance in target languages by adding lightweight CLSR modules on top of whisper-small.