Improve LLM Playground UX

lablup / backend.ai-webui

Backend.AI Web UI for web / desktop app (Windows/Linux/macOS). Backend.AI Web UI provides a convenient environment for users, while allowing various commands to be executed without CLI. It also provides some visual features that are not provided by the CLI, such as dashboards and statistics.

https://www.backend.ai

GNU Lesser General Public License v3.0

110 stars 73 forks source link

Improve LLM Playground UX #2861

Open yomybaby opened 3 days ago

yomybaby commented 3 days ago

Let's improve the LLM Playground UX. If you have any ideas, please leave a comment.

Ideas

When private endpoint:
- Add Token Select
- If there are issued tokens
- Auto select most recently issued token.
- Query /models with the most recently issued token
- If there are no issued tokens:
- Provide a button to issue a token in LLM Chat UI
Add Model ID copy button
Set environments at once. (Or update json file)

Ref

Teams thread