rsxdalv / tts-generation-webui

TTS Generation Web UI (Bark, MusicGen + AudioGen, Tortoise, RVC, Vocos, Demucs, SeamlessM4T, MAGNet, StyleTTS2, MMS)
https://rsxdalv.github.io/tts-generation-webui/
MIT License
1.46k stars 160 forks source link

Title: Potential Upgrade to Gradio 4 for Zero GPU Hosting #298

Closed polarfreez closed 1 week ago

polarfreez commented 2 months ago

Description:

I'm very interested in this project and would love to try hosting an instance on HuggingFace using Zero GPU. However, I noticed that Zero GPU only works with Gradio 4, while this project currently uses Gradio 3.

The main concern I have is whether there are any plans to upgrade this project from Gradio 3 to Gradio 4 in the future. This would be an important requirement for me to be able to host the project on HuggingFace with Zero GPU support.

Some key points:

I'd appreciate any information you can provide on the project's plans for a potential Gradio 4 upgrade. This would help me determine if hosting on HuggingFace with Zero GPU is a viable option. Thank you in advance for your help!

rsxdalv commented 2 months ago

Previously there was zero upside to upgrading to gradio 4 so I planned not to. However, I'm still not sure if it's possible. Due to the lack of features there's a lot of custom code that works with Gradio 3 but could require a rewrite for the upgrade. The two versions are quite incompatible. More so than that I'm working on developing the React based UI since I found Gradio to be too limiting, even after all of the customization that I did. Finally, given how this project installs with multiple requirements files (due to packages like fairseq and omegaconf) I'm unsure it's going to match the template for zero GPU.

Yet the Google colab should work which offers a T4 GPU and is already compatible with this project and React UI.

On Fri, Apr 5, 2024, 3:57 AM Polar @.***> wrote:

Description:

I'm very interested in this project and would love to try hosting an instance on HuggingFace using Zero GPU. However, I noticed that Zero GPU only works with Gradio 4, while this project currently uses Gradio 3.

The main concern I have is whether there are any plans to upgrade this project from Gradio 3 to Gradio 4 in the future. This would be an important requirement for me to be able to host the project on HuggingFace with Zero GPU support.

Some key points:

  • This project looks great and I'm excited to try it out.
  • Hosting on HuggingFace with Zero GPU would be very convenient, as it would allow me to run the project without needing a GPU.
  • However, Zero GPU is only compatible with Gradio 4, while this project currently uses Gradio 3.
  • Will there be an upgrade to Gradio 4 in the future? Or is the project likely to remain on Gradio 3 for the foreseeable future?

I'd appreciate any information you can provide on the project's plans for a potential Gradio 4 upgrade. This would help me determine if hosting on HuggingFace with Zero GPU is a viable option. Thank you in advance for your help!

— Reply to this email directly, view it on GitHub https://github.com/rsxdalv/tts-generation-webui/issues/298, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXI32ZZGML6MPKDJCMO3Y3XZGNAVCNFSM6AAAAABFYHXER6VHI2DSMVQWIX3LMV43ASLTON2WKOZSGIZDMNZWGQ3TQOA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

rsxdalv commented 2 months ago

Also Thanks for informing me about this. I checked the documentation and I can see that there are more requirements for it. I'm not certain if it's really possible for a dedicated GPU project to easily switch because a lot of the functions are trying to do the opposite: on desktop you want to keep the models in cache and reduce the start time as much as possible. Meanwhile here you want to use the GPU as little as possible. I think a couple of models could be compatible with that right now, some are absolutely not able to do that yet.

On Fri, Apr 5, 2024, 12:26 PM Roberts Slisans @.***> wrote:

Previously there was zero upside to upgrading to gradio 4 so I planned not to. However, I'm still not sure if it's possible. Due to the lack of features there's a lot of custom code that works with Gradio 3 but could require a rewrite for the upgrade. The two versions are quite incompatible. More so than that I'm working on developing the React based UI since I found Gradio to be too limiting, even after all of the customization that I did. Finally, given how this project installs with multiple requirements files (due to packages like fairseq and omegaconf) I'm unsure it's going to match the template for zero GPU.

Yet the Google colab should work which offers a T4 GPU and is already compatible with this project and React UI.

On Fri, Apr 5, 2024, 3:57 AM Polar @.***> wrote:

Description:

I'm very interested in this project and would love to try hosting an instance on HuggingFace using Zero GPU. However, I noticed that Zero GPU only works with Gradio 4, while this project currently uses Gradio 3.

The main concern I have is whether there are any plans to upgrade this project from Gradio 3 to Gradio 4 in the future. This would be an important requirement for me to be able to host the project on HuggingFace with Zero GPU support.

Some key points:

  • This project looks great and I'm excited to try it out.
  • Hosting on HuggingFace with Zero GPU would be very convenient, as it would allow me to run the project without needing a GPU.
  • However, Zero GPU is only compatible with Gradio 4, while this project currently uses Gradio 3.
  • Will there be an upgrade to Gradio 4 in the future? Or is the project likely to remain on Gradio 3 for the foreseeable future?

I'd appreciate any information you can provide on the project's plans for a potential Gradio 4 upgrade. This would help me determine if hosting on HuggingFace with Zero GPU is a viable option. Thank you in advance for your help!

— Reply to this email directly, view it on GitHub https://github.com/rsxdalv/tts-generation-webui/issues/298, or unsubscribe https://github.com/notifications/unsubscribe-auth/ABTRXI32ZZGML6MPKDJCMO3Y3XZGNAVCNFSM6AAAAABFYHXER6VHI2DSMVQWIX3LMV43ASLTON2WKOZSGIZDMNZWGQ3TQOA . You are receiving this because you are subscribed to this thread.Message ID: @.***>

rsxdalv commented 1 week ago

Hi, so for the foreseeable future it is not viable to pay the price of upgrading to Gradio 4 and adapting to zero-gpu. This project will probably abandon gradio before upgrading from 3.x versions.