[Feature] 请问function calling是否只适配本项目的后端servcer

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

https://lmdeploy.readthedocs.io/en/latest/

Apache License 2.0

4.67k stars 427 forks source link

Open positive666 opened 5 days ago

positive666 commented 5 days ago

我自己有一套Openai的server 后端，发现使用Intern2lm 无法识别tool calls，想偷个懒，直接问下所以区别在于后端的tools相关代码问题吗？

No response

No response

AllentDan commented 5 days ago

是的，主要是 prompt 的前后处理。可以参考 https://github.com/InternLM/lmdeploy/pull/1763/files