What is the trade off in accuracy from fp32 to fp16

Vaibhavs10 / insanely-fast-whisper

Apache License 2.0

7.76k stars 547 forks source link

Open KeystoneScience opened 8 months ago

KeystoneScience commented 8 months ago

Hello! I was wondering if anyone has benchmarked the trade off in accuracy when using the fp32 vs fp16 on larve-v3?