search

InftyAI / llmaz

☸️ Easy, advanced inference platform for large language models on Kubernetes. 🌟 Star to support our work!
Apache License 2.0
31 stars 10 forks source link

Use rust instead of python to download model weights #40

Closed kerthcet closed 3 months ago

kerthcet commented 3 months ago

fix https://github.com/InftyAI/llmaz/issues/38

kerthcet commented 3 months ago

/kind feature /hold

kerthcet commented 3 months ago

Let's take the https://github.com/InftyAI/llmaz/pull/41 instead. /close for now.