ShishirPatil / gorilla

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
https://gorilla.cs.berkeley.edu/
Apache License 2.0
11.52k stars 1.01k forks source link

[BFCL] some tiny fix in possible_answer #786

Closed zhangch-ss closed 4 days ago

zhangch-ss commented 4 days ago

I found an error ["Invalid value for parameter 'name': 'John Doe'. Expected one of ['j', 'o', 'h', 'n', '', 'd', 'o', 'e']."], in BFCL_v3_live_multiple_score.json. this is because "John Doe" is not a list. {"id": "live_multiple_189-83-0", "ground_truth": [{"sendHttpRequest": {"method": ["POST"], "url": ["https://httpbin.org/post"], "headers": [{"Content-Type": ["application/json"]}], "data": [{"name": "John Doe", "email": "john.doe@example.com"}]}}]} I made a list of all similar errors and fixed them

ERROR:root:java_67:[{'APP_NAME': 'PhotoEditor'}, {'IMAGES_ROOT': '/path/to/images'}, {'BACKGROUND_IMAGE_FOLDER': 'background'}, {'BACKGROUND_IMAGE': 'custom-bg.png'}] value is not a list: PhotoEditor
ERROR:root:java_67:[{'APP_NAME': 'PhotoEditor'}, {'IMAGES_ROOT': '/path/to/images'}, {'BACKGROUND_IMAGE_FOLDER': 'background'}, {'BACKGROUND_IMAGE': 'custom-bg.png'}] value is not a list: /path/to/images
ERROR:root:java_67:[{'APP_NAME': 'PhotoEditor'}, {'IMAGES_ROOT': '/path/to/images'}, {'BACKGROUND_IMAGE_FOLDER': 'background'}, {'BACKGROUND_IMAGE': 'custom-bg.png'}] value is not a list: background
ERROR:root:java_67:[{'APP_NAME': 'PhotoEditor'}, {'IMAGES_ROOT': '/path/to/images'}, {'BACKGROUND_IMAGE_FOLDER': 'background'}, {'BACKGROUND_IMAGE': 'custom-bg.png'}] value is not a list: custom-bg.png
ERROR:root:java_68:[{'/Applications/MyApp.app': 'MyApp'}] value is not a list: MyApp
ERROR:root:javascript_5:[{'useStateSelector': 'useStateSelectorHook', 'useDispatchAction': 'useDispatchActionHook'}] value is not a list: useStateSelectorHook
ERROR:root:javascript_5:[{'useStateSelector': 'useStateSelectorHook', 'useDispatchAction': 'useDispatchActionHook'}] value is not a list: useDispatchActionHook
ERROR:root:live_multiple_189-83-0:[{'name': 'John Doe', 'email': 'john.doe@example.com'}] value is not a list: John Doe
ERROR:root:live_multiple_189-83-0:[{'name': 'John Doe', 'email': 'john.doe@example.com'}] value is not a list: john.doe@example.com