sozercan / aikit

🏗️ Fine-tune, build, and deploy open-source LLMs easily!
https://sozercan.github.io/aikit/
MIT License
384 stars 28 forks source link

[REQ] create status.d metadata files for llama backend cuda images #68

Closed sozercan closed 10 months ago

sozercan commented 10 months ago

What kind of request is this?

None

What is your request or suggestion?

currently aikit generates packages metadata as a file (debian standard) for cuda images. since images are based on distroless (which uses status.d folder), this creates a mixed package metadata environment

this only affects cuda images since they install cuda libraries from nvidia https://explore.ggcr.dev/layers/ghcr.io/sozercan/llama2@sha256:8d388f7af641fa199639d78a99f655f3c80d41332f44561dfbbc3391db21b31c/var/lib/dpkg/status

convert status file to files in status.d dir https://explore.ggcr.dev/layers/ghcr.io/sozercan/llama2@sha256:8d388f7af641fa199639d78a99f655f3c80d41332f44561dfbbc3391db21b31c/var/lib/dpkg/status.d/

Are you willing to submit PRs to contribute to this feature request?