search

mlc-ai / binary-mlc-llm-libs

200 stars 45 forks source link

[SLM] Llama mistral and redpajama for cuda vulkan and metal #58

Closed CharlieFRuan closed 9 months ago

CharlieFRuan commented 9 months ago

Note these models do not support dynamic vocab size yet