containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers
https://podman-desktop.io/extensions/ai-lab
Apache License 2.0
145 stars 23 forks source link

Suggestion: Provide alternative playground to model interaction with open-webui integration. #1297

Open cdrage opened 3 days ago

cdrage commented 3 days ago

Epic domain

Problem:

Chat / Playgrounds for LLM communication is very difficult to code because there are so many formats to think about (markdown, html, graphs, special codes, etc.).

So many different styling that communities have come together to solve that issue, aka open-webui.

An example of an issue in AI Lab:

Screenshot 2024-06-26 at 9 10 11 AM

Proposed suggestion:

Offer an alternative such as using open-webui to communicate with a model.

Either by embedding open-webui within PD so you do not have to leave it, or having it open in an external link to our other example integrations (RAG).

Benefits

Additional context

No response