search

sozercan / aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!
https://sozercan.github.io/aikit/
MIT License
306 stars 27 forks source link

[REQ] support for models from oci artifacts #241

Closed sozercan closed 1 month ago

sozercan commented 2 months ago

What kind of request is this?

New feature

What is your request or suggestion?

Download models hosted as OCI artifacts

Are you willing to submit PRs to contribute to this feature request?

sozercan commented 2 months ago

https://oci.dag.dev/?image=registry.ollama.ai/library/llama3:latest

crane blob registry.ollama.ai/library/llama3@sha256:6a0746a1ec1aef3e7ec53868f220ff6e389f6f8ef87a01d77c96807de94ca2aa

docker build --build-args "model=oci://registry.ollama.ai/library/llama3:8b" ...

sozercan commented 1 month ago

Fixed with #296