unit-mesh / auto-dev

🧙‍AutoDev: The AI-powered coding wizard(AI 驱动编程助手)with multilingual support 🌐, auto code generation 🏗️, and a helpful bug-slaying assistant 🐞! Customizable prompts 🎨 and a magic Auto Dev/Testing/Document/Agent feature 🧪 included! 🚀
https://ide.unitmesh.cc/
Mozilla Public License 2.0
2.78k stars 317 forks source link

如何配置本地部署的LLM, deepseek-coder-7b? #147

Closed biostone closed 6 months ago

biostone commented 6 months ago

Describe the bug

本地用vllm部署了deepseek-coder-7b, OpenAI compatible 模式。用NextChat,Continue.dev 都测试过,LLM server是部署成功的。

但是,在Auto-Dev中不可以用,具体请看附件截图。

Unit Mesh 这个理念非常正点,非常希望能够用起来。谢谢!

To Reproduce Steps to reproduce the behavior:

  1. Go to '...'
  2. Click on '....'
  3. Scroll down to '....'
  4. See error

Expected behavior A clear and concise description of what you expected to happen.

Screenshots If applicable, add screenshots to help explain your problem.

Desktop (please complete the following information):

Additional context

image
phodal commented 6 months ago

上面显示 404,这不是路径不对吗。。我猜可能是你多了个 /v1/chat

图片
biostone commented 6 months ago

现在好了,应该是没有点“Apply”的缘故。低级错误啊,被自己雷倒了。

image