open-compass / T-Eval

[ACL2024] T-Eval: Evaluating Tool Utilization Capability of Large Language Models Step by Step
https://open-compass.github.io/T-Eval/
Apache License 2.0
235 stars 15 forks source link

Tool Set的问题 #27

Open yitianlian opened 9 months ago

yitianlian commented 9 months ago

请问一下有意向对于tool set进行开源吗

zehuichen123 commented 9 months ago

目前开了一些在lagent下(https://github.com/InternLM/lagent/tree/main/lagent/actions) , 完整开源的话可能得看lagent那边开发安排了

yitianlian commented 9 months ago

okok,也想问一下我看论文中tool selection说有对于tool进行complete document,这一部分请问是在哪里呢?

zehuichen123 commented 9 months ago

这部分最近我整理一下 会在这一两天放出来~

yitianlian commented 9 months ago

okok,也就是说完整的dataset生成的过程开源需要再等等?

zehuichen123 commented 9 months ago

emmm 完整的dataset生成流程暂时不考虑开源 sry~api document已经push在docs/api_descrip.json里了~