elixir-nx / bumblebee

Pre-trained Neural Network models in Axon (+ 🤗 Models integration)
Apache License 2.0
1.27k stars 90 forks source link

Add support for streaming speech-to-text results #242

Closed jonatanklosko closed 10 months ago

jonatanklosko commented 10 months ago

Large audio is split into multiple chunks, now we support stream: true, so that output chunks are emitted as soon as they are available.

jonatanklosko commented 10 months ago

@josevalim Nx should be good to go with respect to streaming, awesome job!