search

hkust-nlp / AgentBoard

An Analytical Evaluation Board of Multi-turn LLM Agents
250 stars 26 forks source link

reactagent版本是还没有上传吗？ #5

Open Fu-Dayuan opened 8 months ago

Fu-Dayuan commented 8 months ago

如题，reactagent版本好像不太对. 除了tools以外，其他的react版本会上传吗？（而且貌似reactagent要改一下，改成用正则表达式抽取的形式）

yc1999 commented 8 months ago

We provide react agent for tool tasks. If you have any questions on this and have troubles in implementing other tasks, we are willing to help.

Fu-Dayuan commented 7 months ago

We provide react agent for tool tasks. If you have any questions on this and have troubles in implementing other tasks, we are willing to help.

想请问一下babyai，jericho和pddl的act-only prompt有来源吗(指的是他们的example是怎么编的，其他几个我都在原数据集等地方找到了）？我这几个没找到

chang-github-00 commented 7 months ago

These prompts are originally created by our benchmark. All three tasks are adapted by ourselves, thus lacking source.

leoozy commented 7 months ago

如题，reactagent版本好像不太对. 除了tools以外，其他的react版本会上传吗？（而且貌似reactagent要改一下，改成用正则表达式抽取的形式） Becase the prompt stypes for agent are diverse, it is hard to provide off-the-shelf prompts to meet all the requirements. Instead, we provide the naive prompt style and easy-to-use customization function. If you have any problem, feel free to contact me.