AlibabaResearch / DAMO-ConvAI

DAMO-ConvAI: The official repository which contains the codebase for Alibaba DAMO Conversational AI.
MIT License
1.1k stars 178 forks source link

[API-Bank]为什么toolsearch用的是SentenceTransformer来做api搜索? #74

Closed fackee closed 8 months ago

fackee commented 10 months ago

为什么toolsearch用的是SentenceTransformer来做api搜索?在测试中发现,SentenceTransformer做搜索的准确率问题也影响整个工作流的准确率。可以用大模型直接识别用户意图然后找到具体的API吗?

liminghao1630 commented 8 months ago

We hope to explore the basics of the whole process in API-Bank, so we chose the simplest implementation method and look forward to more research to explore different implementation forms of the retriever. (Including the use of the LLMs Agent you mentioned for retrieval)

The accuracy problem you raised does exist, which is an inevitable problem of using independent retrievers.