search

ShishirPatil / gorilla

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
https://gorilla.cs.berkeley.edu/
Apache License 2.0
11.52k stars 1.01k forks source link

[BFCL] Multi Turn Pipeline Robustness Patch #724

Closed HuanzhiMao closed 1 month ago

HuanzhiMao commented 1 month ago

This PR adds checks to prevent unsafe function calls from being run and potentially breaking the evaluation pipeline.

  1. In GorillaFileSytem, the xargs method is removed. This will not affect the dataset entries, and that function is not used in any entries.
  2. In execute_multi_turn_func_call, an input filter has been implemented to prevent the execution of unsafe function calls like kill, exit, remove, etc.