search

Canner / WrenAI

🚀 An open-source SQL AI (Text-to-SQL) Agent that empowers data, product teams to chat with their data. 🤘
https://getwren.ai/oss
GNU Affero General Public License v3.0
2.04k stars 211 forks source link

Implement HuggingFaceAPIGenerator as a new custom LLM #471

Closed cyyeh closed 3 weeks ago

cyyeh commented 4 months ago

Currently we officially support several types of LLMs, such as OpenAI, OpenAI api-compatible and Ollama. We also released a documentation on how to write your custom LLM: https://docs.getwren.ai/oss/installation/custom_llm

I hope this issue can attract the community members who are interested to contribute to HuggingFaceAPIGenerator LLM based on the guide provided above!

If you would like to contribute, please comment below and let others know. If you have any issues for the implementation, welcome to raise below and discuss with us. Thank you 💯

lidelinsdu commented 3 weeks ago

the link is 404 now

cyyeh commented 3 weeks ago

@lidelinsdu thanks for reporting, we've updated the link. However, we are planning to adopt litellm in the near future. so I'll close the issue as of now