Open hahuyhoang411 opened 4 weeks ago
Zamba2-7B-Instruct is a hybrid model composed of state-space (Mamba2) and transformer blocks.
HF: https://huggingface.co/Zyphra/Zamba2-7B-Instruct
llama.cpp state: https://github.com/ggerganov/llama.cpp/pull/7531
hahuyhoang411
commented
4 weeks ago hahuyhoang411
commented
4 weeks ago
Zamba2-7B-Instruct is a hybrid model composed of state-space (Mamba2) and transformer blocks.
HF: https://huggingface.co/Zyphra/Zamba2-7B-Instruct
llama.cpp state: https://github.com/ggerganov/llama.cpp/pull/7531