search

deadbits / vigil-llm

⚡ Vigil ⚡ Detect prompt injections, jailbreaks, and other potentially risky Large Language Model (LLM) inputs
https://vigil.deadbits.ai/
Apache License 2.0
270 stars 32 forks source link

Update Dockerfile to greatly minimize final image size #68

Closed w8mej closed 7 months ago

w8mej commented 7 months ago

When you don't use apt-get's --no-install-recommends flag, you install all the recommended packages for the package and the package itself. By implementing this parameter, I was able to decrease my image size by ~20% on my various arch. builds. I haven't calculated the build time savings yet.

An older reference to why this can be meaningful for this project - https://ubuntu.com/blog/we-reduced-our-docker-images-by-60-with-no-install-recommends .

deadbits commented 7 months ago

This is awesome! I admit the Docker container was a bit of an afterthought but I’m happy to take any improvements.

I’m out of town until Sunday but I’ll fully review this (and your other issues/PRs, thanks again!) once I get back and get them merged in

w8mej commented 7 months ago

Anytime. Glad I could help. Keep up the great work!

w8mej commented 7 months ago

Thank you! Have a great week.