Closed the-crypt-keeper closed 6 months ago
New open source instruction tune from Google.
GGUF support just merged https://github.com/ggerganov/llama.cpp/pull/5631
vLLM 0.3.2 adds Gemma and OLMo (what is this?) models: https://github.com/vllm-project/vllm/releases/tag/v0.3.2
Completed with much disappointment.
New open source instruction tune from Google.
GGUF support just merged https://github.com/ggerganov/llama.cpp/pull/5631