search

THUNLP-MT / StableToolBench

A new tool learning benchmark aiming at well-balanced stability and reality, based on ToolBench.
https://zhichengg.github.io/stb.github.io/
Apache License 2.0
102 stars 13 forks source link

role error #16

Closed farawayxxx closed 3 weeks ago

farawayxxx commented 3 months ago

When I used CoT to reproduce your code, the generated answer's role appeared as 'tool' instead of the given answer's 'function', which caused an error in convert_answer. Have you encountered this issue?

image
farawayxxx commented 3 months ago

openai的调用方式从function_call变成了tool_call，导致生成的json格式发生改变。run_convert_answer.sh脚本却没有更新，导致无法进行format。