huggingface / distil-whisper

Distilled variant of Whisper for speech recognition. 6x faster, 50% smaller, within 1% word error rate.
MIT License
3.32k stars 238 forks source link

[training] update pseudo-labelling for ddp #108

Closed sanchit-gandhi closed 2 months ago

sanchit-gandhi commented 2 months ago

Accelerate fixes to enable ddp with the pseudo-labelling stage. Next step is confirming it works with the training script.

sanchit-gandhi commented 2 months ago

cc @eustlb