Request to install PyCUDA in gradio Demo

gradio-app / gradio

Build and share delightful machine learning apps, all in Python. 🌟 Star to support our work!

http://www.gradio.app

Apache License 2.0

30.56k stars 2.27k forks source link

Request to install PyCUDA in gradio Demo #8567

Closed iofu728 closed 1 week ago

iofu728 commented 1 week ago

[x] I have searched to see if a similar issue already exists.

I am trying to build an efficient long-context LLMs inference demo in HF Demo using both ZeroGPU or general GPUs like L4. Unfortunately, I can't install PyCUDA, which is essential for my project. Is it possible to get support for this?

abidlabs commented 1 week ago

Hi @iofu728 this is not a question for the gradio library, the right place to ask about Spaces would be here: https://discuss.huggingface.co/c/spaces/24