OpenBMB / ToolBench

[ICLR'24 spotlight] An open platform for training, serving, and evaluating large language model for tool learning.
https://openbmb.github.io/ToolBench/
Apache License 2.0
4.62k stars 397 forks source link

Evaluation Cost for ToolEval #227

Open zehuichen123 opened 6 months ago

zehuichen123 commented 6 months ago

Hi, thanks for your great work. Since most of the evaluation processes are based on the subjective evaluation by GPT, I am wondering about the cost for each evaluation (not for an exact value, just an estimation will be ok).