search

open-compass / T-Eval

[ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step
https://open-compass.github.io/T-Eval/
Apache License 2.0
228 stars 14 forks source link

BUG: stop_words #33

Open ZHUANGMINGXI opened 8 months ago

ZHUANGMINGXI commented 8 months ago

C8525B49-952C-4418-B0A1-474F1F60C937 I followed the author's commands exactly, but KeyError: stop_words, how to solve it?

zehuichen123 commented 8 months ago

Hi, could you provide your running command? So that we can reproduce your problem

ZHUANGMINGXI commented 8 months ago

Hi, could you provide your running command? So that we can reproduce your problem

sh test_all_zh.sh api gpt-4-1106-preview gpt4 qwen

zehuichen123 commented 8 months ago

Do you update your lagent code to the newest main branch?

ZHUANGMINGXI commented 8 months ago

Do you update your lagent code to the newest main branch?

Yes, but there is still this problem.

zehuichen123 commented 8 months ago

Do you run pip install -e . after you update lagent code? I can not reproduce your problem currently:)