[BFCL] Leaderboard Update, #672 Part 2

ShishirPatil / gorilla

Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)

https://gorilla.cs.berkeley.edu/

Apache License 2.0

11.52k stars 1.01k forks source link

[BFCL] Leaderboard Update, #672 Part 2 #715

Closed HuanzhiMao closed 1 month ago

HuanzhiMao commented 1 month ago

This PR adds the rest of the models that wasn't included in #672.

In addtion, the meta-llama/Llama-3.2-1B-Instruct-FC and meta-llama/Llama-3.2-3B-Instruct-FC are removed because according to the official Llama doc, their function calling are done using the prompt style chat template, not the specialized function-calling style.

ShishirPatil commented 1 month ago

Does this also address https://github.com/sgl-project/sglang/issues/1750 ?

HuanzhiMao commented 1 month ago

Does this also address sgl-project/sglang#1750 ?

Yes