add llama-2 - Githubissues

tensorchord / modelz-llm

OpenAI compatible API for LLMs and embeddings (LLaMA, Vicuna, ChatGLM and many others)

https://modelz.ai

Apache License 2.0

265 stars 26 forks source link

Closed antonkulaga closed 1 year ago

antonkulaga commented 1 year ago

It would be nice to get llama-2 support, including quantized versions

gaocegege commented 1 year ago

Yeah, we are working on this.

/cc @kemingy