InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Apache License 2.0
30 stars 10 forks source link

[WebUI] Add support for webui #160

Open kerthcet opened 2 months ago

kerthcet commented 2 months ago

What would you like to be added:

Once we launched a model, we can simply co-launch a webui for interaction, we can support llmpos tools like dify but maybe we can find or create a lightweight one like gradio.

We also have a repo located here which implemented with gradio https://github.com/InftyAI/llmaz-dashboard.

Why is this needed:

For better UX.

Completion requirements:

This enhancement requires the following artifacts:

The artifacts should be linked in subsequent comments.

kerthcet commented 2 months ago

/kind feature

kerthcet commented 1 month ago

/help