Streaming as words are generated?

BuffMcBigHuge / text-generation-webui-edge-tts

A very simple implementation of edge_tts w/ RVC for oobabooga text-generation-webui.

41 stars 3 forks source link

Streaming as words are generated? #10

Closed sion42x closed 7 months ago

sion42x commented 8 months ago

Hi, great job on this and it works GREAT on my phi-2 chatbot for Orange Pi 5 Plus project!

Is it possible to implement streaming (see https://github.com/rany2/edge-tts/blob/master/examples/basic_audio_streaming.py) to have the API called and read as text is generated?

BuffMcBigHuge commented 7 months ago

Hey @sion42x, I'm sure it can be implemented, however streaming it along with RVC wouldn't be easy, which seems to be the primary use case of this extension.