-
### Proposal to improve performance
vLLM is amazingly fast
However, when running below prompt, with meta-llama/Meta-Llama-3-8B-Instruct, Gradio takes ~4sec per prompt (one by one) while vLLM takes…
-
I would like to propose adding support for Gradio WebUI to this project. The current terminal input experience is not very user-friendly. Gradio could significantly enhance the usability and accessibi…
-
![image](https://github.com/user-attachments/assets/571c8886-e4b4-42dc-a17e-644a5c359fa1)
How to add the start point and ending point? I tried left click and right click and do not find related but…
-
I want it to be compatible with Gradio 4. forge
-
I'm experiencing an issue with my Gradio app where the visualization part is empty. I'm not sure if the problem lies with Triton-Viz or Gradio.
```python
@triton.jit
def demo(x_ptr):
i_range…
-
### Feature request / 功能建议
how to support multiple user for same gradio web instance ?
### Motivation / 动机
1 model instance to serve many users generation at the same time
### Your contribution /…
-
I want it to be compatible with Gradio 4. Forge
-
### Description
Hi.
Gradio is a prominent python webui framework with definitevely an overlapping use case with rio. Gradio also supports [custom components](https://www.gradio.app/main/guides/cus…
-
```
C:\Users\Matrix\forge\webui\extensions\sd-webui-nudenet-nsfw-censor\scripts\nudenet_nsfw_censor_scripts\post_processing_script.py:64: GradioDeprecationWarning: unexpected argument for Image: tool…
-
### Expected behavior
I want it to be compatible with Gradio 4. Forge