aymeric-roucher / agent_reasoning_benchmark

🔧 Compare how Agent systems perform on several benchmarks. 📊🚀
Apache License 2.0
47 stars 5 forks source link

Agent.write_inner_memory_from_logs() got an unexpected keyword argument 'only_tool_calls' #5

Open ahjwang opened 2 months ago

ahjwang commented 2 months ago

Hello, I'm trying to reproduce the numbers on GAIA found in the announcement post. When I run gaia.py I get the following error: Agent.write_inner_memory_from_logs() got an unexpected keyword argument 'only_tool_calls' that comes from this line of code: https://github.com/aymeric-roucher/agent_reasoning_benchmark/blob/00469f509dce67b48beb3890dfb707a0f89c4c32/gaia.py#L231 I tried searching through previous versions of the transformers library, but I can't seem to find any version of write_inner_memory_from_logs() that contains an argument for only_tool_calls.

Thank you for looking into this!

bofei5675 commented 2 months ago

Same problem.

aymeric-roucher commented 3 weeks ago

This should be fixed in the latest commit thatI just pushed: could you try again?

aymeric-roucher commented 3 weeks ago

Also, you can find a newer version of this attempt to top GAIA here: https://github.com/aymeric-roucher/GAIA