containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers
https://podman-desktop.io/extensions/ai-lab
Apache License 2.0
168 stars 30 forks source link

Evaluate architecture design between ApplicationManager, RecipeManager and InferenceServer #1542

Open axel7083 opened 1 month ago

axel7083 commented 1 month ago

Is your enhancement related to a problem? Please describe

Following https://github.com/containers/podman-desktop-extension-ai-lab/pull/1503 we need to improve the way components are interacting togethers.

Describe the solution you'd like

See discussion and proposal on https://github.com/containers/podman-desktop-extension-ai-lab/pull/1503#issuecomment-2288133263

Describe alternatives you've considered

No response

Additional context

No response

axel7083 commented 1 month ago

See https://github.com/containers/ai-lab-recipes/issues/758