Gradio API: cannot schedule new futures after shutdown

huggingface / speech-to-speech

Speech To Speech: an effort for an open-sourced and modular GPT4-o

Apache License 2.0

3.47k stars 361 forks source link

Gradio API: cannot schedule new futures after shutdown #131

Open dtardieu opened 1 week ago

dtardieu commented 1 week ago

I am trying to use the Gradio API in speechtospeech. I coded the interface for a new "language model" that is in that case the gradio API. Everything works fine until I use client.predict inside the process function. Then I get "RuntimeError: cannot schedule new futures after shutdown"

the predict function works inside the warmup function.

Any idea what is happening ?

andimarafioti commented 1 week ago

No clue, could you add more details? We also struggled to get this to work with Gradio :(