Use a vllm variant that supports Danube2 and 3

h2oai / h2ogpt

Private chat with local GPT with document, images, video, etc. 100% private, Apache 2.0. Supports oLLaMa, Mixtral, llama.cpp, and more. Demo: https://gpt.h2o.ai/ https://gpt-docs.h2o.ai/

http://h2o.ai

Apache License 2.0

11.42k stars 1.25k forks source link

Use a vllm variant that supports Danube2 and 3 #1780

Closed achraf-mer closed 3 months ago