search

xorbitsai / inference

Replace OpenAI GPT with another LLM in your app by changing a single line of code. Xinference gives you the freedom to use any LLM you need. With Xinference, you're empowered to run inference with any open-source language models, speech recognition models, and multimodal models, whether in the cloud, on-premises, or even on your laptop.
https://inference.readthedocs.io
Apache License 2.0
5.46k stars 444 forks source link

是否考虑支持Sqlcoder #1693

Open leeyis opened 5 months ago

leeyis commented 5 months ago

sqlcoder

目前sqlcoder在text2sql领域表现不错，在很多数据应用开发中被广泛使用，希望官方可以提供推理支持

qinxuye commented 5 months ago

这个模型之前看过，但用法好像和别的 LLM 不太一样，需要专门适配。你有啥看法吗？

mrkingsun commented 4 months ago

看到dbgpt适配了llama3-sqlcoder-8b，按照sqlcoder官方的prompt模板应该就可以，希望xinference可以适配

suiquantong commented 4 months ago

+1

nikelius commented 4 months ago

sqlcoder已经有三代版本了，三者的基座模型都不一样：

nikelius commented 4 months ago

ollama都适配了，差别会很大吗？

github-actions[bot] commented 3 months ago

This issue is stale because it has been open for 7 days with no activity.