search

replicate / cog

Containers for machine learning
https://cog.run
Apache License 2.0
7.53k stars 523 forks source link

Streaming audio #1409

Open platform-kit opened 7 months ago

platform-kit commented 7 months ago

I know that Replicate supports streaming output for LLM's.

Is there any reason this shouldn't be easy to implement for streaming audio?

One very obvious application would be streaming text-to-speech output in near-realtime.

I can imagine a lot of apps being built with that (and that's my intended use-case) - or streaming music with MusicGen, AudioGen, etc.

lauraibnz commented 3 months ago

Hi, I would like to know if there is any plan on releasing this feature. It would be really useful for text-to-speech and generative music tasks. Thanks!

tripathiarpan20 commented 3 months ago

Same question!