issues
search
ShishirPatil
/
gorilla
Gorilla: Training and Evaluating LLMs for Function Calls (Tool Calls)
https://gorilla.cs.berkeley.edu/
Apache License 2.0
11.52k
stars
1.01k
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
[BFCL] bugs in function def _multi_threaded_inference(self, test_case, include_input_log: bool, include_state_log: bool):
#753
pikepokenew
closed
2 weeks ago
1
[BFCL] Update Llama Prompting Handler for Llama 3.0 vs. 3.1 Chat Template Differences
#752
HuanzhiMao
closed
3 days ago
0
[BFCL] Prompt Caching for Claude Models
#751
VishnuSuresh27
closed
2 weeks ago
0
[BFCL] Add `claude-3-5-haiku-20241022`, `claude-3-5-haiku-20241022-FC`, `claude-3-5-sonnet-20241022`, `claude-3-5-sonnet-20241022-FC`
#750
HuanzhiMao
closed
1 week ago
0
[BFCL] Remove `Llama-3.2-3B-Instruct-FC` and `Llama-3.2-1B-Instruct-FC` from Leaderboard
#749
HuanzhiMao
closed
2 weeks ago
0
[BFCL] Leaderboard Update, 11/17/2024
#748
HuanzhiMao
closed
1 week ago
6
[BFCL] Minor Grammatical Corrections to DEFAULT_SYSTEM_PROMPT
#747
HuanzhiMao
closed
2 weeks ago
0
[BFCL] Chore: Improve Inference Log Readability
#746
HuanzhiMao
closed
2 weeks ago
0
[BFCL Dataset Revamp 4/n] Multi-Turn (Part 2)
#745
Fanjia-Yan
closed
2 weeks ago
0
Updated readme
#744
YLu-1258
closed
3 weeks ago
0
[BFCL] Add Support for Regeneration, Specific Test Entry IDs, and Custom Directory Locations
#743
Raymond112514
closed
4 days ago
3
[BFCL] Added EventPlanningAPI for multi-turn for BFCL
#742
daanaea
opened
3 weeks ago
0
[BFCL] I tested some oss model on the AST dataset offline using a local environment, and the scores differ significantly from the leaderboard. What points might I have overlooked? Here are the results of the experiment.
#741
17828079650
closed
2 weeks ago
4
[BFCL Dataset Revamp 1/n] Multi-Turn (Part 1)
#740
Fanjia-Yan
closed
2 weeks ago
0
[BFCL Dataset Revamp 3/n] Live Dataset Fix (Multiple)
#739
Fanjia-Yan
closed
2 weeks ago
0
[BFCL] Miss Param score is very low
#738
HumanMadeAgents
opened
3 weeks ago
1
[BFCL Dataset Revamp 2/n] Live Dataset Fix (Simple, Parallel, Parallel Multiple)
#737
Fanjia-Yan
closed
2 weeks ago
0
[BFCL] Add the option to log to WandB during bfcl evaluate
#736
ThomasRochefortB
closed
1 week ago
3
[BFCL] Remove duplicate in eval_runner.py
#735
ThomasRochefortB
closed
3 weeks ago
0
[BFCL] Are there any dependencies between 'bfcl generate' and 'bfcl evaluate'
#734
TurboMa
opened
3 weeks ago
3
[BFCL] Refine Evaluation Metric for Multi Turn Categories
#733
HuanzhiMao
closed
3 weeks ago
0
[BFCL] Multi Turn Dataset Fix (Miss Param)
#732
HuanzhiMao
closed
4 weeks ago
0
[BFCL] Small typo in variable name in travel_booking.py
#731
daanaea
closed
4 weeks ago
0
[BFCL] Patch #724
#730
HuanzhiMao
closed
4 weeks ago
0
[Apibench] AST Eval Error on Huggingface and Tensorflowhub
#729
HHHHHejia
opened
4 weeks ago
0
[BFCL] Multi Turn Dataset Fix (Miss Func & Long Context)
#728
HuanzhiMao
closed
4 weeks ago
0
[BFCL] Add Prompt Caching for Claude Models
#727
vsvaidya27
closed
2 weeks ago
2
[BFCL] How to Evaluate the Spark Giant Model:
#726
lonelysheeep
closed
2 weeks ago
1
[BFCL] Update Eval Metric for Multi Turn Irrelevance Scenarios
#725
HuanzhiMao
closed
4 weeks ago
0
[BFCL] Multi Turn Pipeline Robustness Patch
#724
HuanzhiMao
closed
1 month ago
0
[BFCL] Multi Turn Dataset Fix (Base Category)
#723
HuanzhiMao
closed
1 month ago
0
[BFCL] Multi Turn Dataset Fix (Function Doc)
#722
HuanzhiMao
closed
1 month ago
0
Added multi-turn test cases and debugging results
#721
hheidy0463
opened
1 month ago
0
[BFCL] Adding New Model GoGoAgent
#720
RogueTensor
closed
2 weeks ago
0
[BFCL] Multi Turn Dataset and Possible Answer Fix (Base Category)
#719
HuanzhiMao
closed
1 month ago
0
Add minicpm3 4b FC model handler
#718
Cppowboy
closed
3 days ago
6
[BFCL] Chore: Separate out Func Doc for Multi-Turn Categories
#717
HuanzhiMao
closed
1 month ago
0
Add batch processing for ClaudeHandler
#716
yutongxie58
opened
1 month ago
1
[BFCL] Leaderboard Update, #672 Part 2
#715
HuanzhiMao
closed
1 month ago
2
multi-turn base 188-rest cleaning (last 15 error type 4)
#714
CharlieJCJ
closed
1 month ago
0
(typo):I've made some corrections to your repository to improve clarity
#713
PrathameshSPawar
closed
1 month ago
0
[BFCL] Support Dynamic max_tokens for Locally-Hosted Models
#712
HuanzhiMao
closed
3 weeks ago
0
Change message api
#711
Fanjia-Yan
closed
1 month ago
0
[WIP] Multi-turn Augmentation based on base change
#710
Fanjia-Yan
closed
1 month ago
0
[BFCL v1] Rephrase Question for Better Clarity for Java & JavaScript Categories
#709
HuanzhiMao
closed
1 month ago
0
[BFCL v1] Update Executable Ground Truth for REST Category
#708
CharlieJCJ
closed
1 month ago
0
Add Contibution.md file
#707
Parth4git
opened
1 month ago
1
[BFCL] How to generate evaluate data in custom domain?
#706
Watebear
opened
1 month ago
1
[BFCL] Writer’s Palmyra X 004
#705
farawayxxx
closed
1 month ago
1
[BFCL] Detailed score for each item
#704
GeniusYx
closed
1 month ago
1
Previous
Next