search

HowieHwong / MetaTool

[ICLR 2024] MetaTool Benchmark for Large Language Models: Deciding Whether to Use Tools and Which to Use
MIT License
70 stars 8 forks source link

wrong paths on the code #3

Open cp-jose opened 10 months ago

cp-jose commented 10 months ago

There are many paths that don't match between code and repository. I've been fixing the ones that are obvious, but can't seem to find this one '../prompt_data/general_test.json'. What does this refer to, and where can it be found?

HowieHwong commented 10 months ago

There are many paths that don't match between code and repository. I've been fixing the ones that are obvious, but can't seem to find this one '../prompt_data/general_test.json'. What does this refer to, and where can it be found?

Sorry for the late reply. '../prompt_data/general_test.json' is generated by prompt_construction.py and you should firstly run it.

cp-jose commented 10 months ago

OK. The problem is the directories have wrong names, and the code isn't running because of that. You may want to fix that. 'prompt_data' directory does not exist, and must be created. I ran 'python prompt_construction.py similar' successfully now and the file '../prompt_data/general_test.json' was generated (after creating the hosting directory).

I'm now trying to run 'python prompt_construction.py all' and it is breaking at: FileNotFoundError: [Errno 2] No such file or directory: '../prompt/multi_tool_selection'

HowieHwong commented 10 months ago

It's ../prompt/multi_tool_selection.json. I will fixed them ASAP.

cp-jose commented 10 months ago

i'm afraid that file doesn't exist either. Would that be './dataset/data/multi_tool_query_golden.json' instead?