search

OSU-NLP-Group / TravelPlanner

[ICML'24 Spotlight] "TravelPlanner: A Benchmark for Real-World Planning with Language Agents"
https://osu-nlp-group.github.io/TravelPlanner/
MIT License
215 stars 27 forks source link

Bug fix: fix tool name DistanceMatrix in prompt #4

Closed JasonZhu1313 closed 6 months ago

JasonZhu1313 commented 6 months ago

In the prompt, the model is instructed to use the DistanceMatrix tool. However, the actual tool name that is callable is GoogleDistanceMatrix. This mistake will cause the model to initially call DistanceMatrix and then fail with an observation stating that it needs to call the correct tool from the set {... GoogleDistanceMatrix ...} before making the right call. This is likely unintentional, and the model is not supposed to be aware of such a discrepancy.

JasonZhu1313 commented 6 months ago

@hsaest Could you kindly provide review for this simple PR, thanks

hsaest commented 6 months ago

@JasonZhu1313

Thank you for the suggestion. We have merged your PR. In the initial version code, we actually adopted the name "GoogleDistanceMatrix" in the prompt. We changed this in the released code, considering the consistency of the paper and code. Please be assured that this will not influence the experiment results shown in the paper. Sorry for the caused confusion.

As you mentioned, we now use "GoogleDistanceMatrix" consistenly in the code.