Implement AI model caching for CI jobs - Githubissues

containers / podman-desktop-extension-ai-lab

Work with LLMs on a local environment using containers

https://podman-desktop.io/extensions/ai-lab

Apache License 2.0

169 stars 30 forks source link

Implement AI model caching for CI jobs #1510

Open ScrewTSW opened 1 month ago

ScrewTSW commented 1 month ago

Is your enhancement related to a problem? Please describe

Follow-up to discussion https://github.com/containers/podman-desktop-extension-ai-lab/pull/1505#issuecomment-2273788259

Describe the solution you'd like

Implement a caching method that would pre-pull the AI model, so it doesn't have to be downloaded every time the job is run

Describe alternatives you've considered

No response

Additional context

challenge will be to make sure the cached model is up to date with what the extension requests

axel7083 commented 1 month ago

Duplicate of https://github.com/containers/podman-desktop-extension-ai-lab/issues/1506 ?