search

InftyAI / Llmaz

⚒ A building block for users to build/serve their own LLM from A to Z on Kubernetes.
https://InftyAI.com
Apache License 2.0
3 stars 4 forks source link

Disabel preload model when loaded #11

Closed kerthcet closed 7 months ago

kerthcet commented 7 months ago

FIx: https://github.com/InftyAI/Llmaz/issues/6