Canner / WrenAI

🚀 An open-source SQL AI (Text-to-SQL) Agent that empowers data, product teams to chat with their data. 🤘
https://getwren.ai/oss
GNU Affero General Public License v3.0
2.04k stars 211 forks source link

Implement NvidiaGenerator as a new custom LLM #470

Closed cyyeh closed 3 weeks ago

cyyeh commented 4 months ago

Currently we officially support several types of LLMs, such as OpenAI, OpenAI api-compatible and Ollama. We also released a documentation on how to write your custom LLM: https://docs.getwren.ai/installation/custom_llm#adding-a-custom-llm-or-document-store-to-wren-ai

I hope this issue can attract the community members who are interested to contribute to NvidiaGenerator LLM based on the guide provided above!

If you would like to contribute, please comment below and let others know. If you have any issues for the implementation, welcome to raise below and discuss with us. Thank you 💯