zhaohb / fastapi_tritonserver

23 stars 3 forks source link

转openai接口,还使用了agent调用了大模型嘛 #1

Open hjunjie0324 opened 1 week ago

hjunjie0324 commented 1 week ago

使用该项目成功将tritonserver部署的qwen模型转为openai-compatible api,感谢! 但是openai_api.py的代码看不太懂,是用了agent调用了大模型嘛。

zhaohb commented 1 week ago

没有调用大模型,也没用到agent,只是支持了openai的接口规范