search

Blair-Johnson / batch-whisper

Batch Support for OpenAI Whisper
MIT License
82 stars 21 forks source link

Batch inference doesn't seem to work with beam search #4

Open KMC07 opened 1 year ago

KMC07 commented 1 year ago

Hello, I'm just wondering if batch inference not working with beam search is intentional or you just haven't gotten to it yet?

Blair-Johnson commented 1 year ago

Haven't gotten to it yet. There's an initial commit on this branch, but it seems to have introduced bugs with the default decoding behavior. Feel free to take a look.