OpenGenerativeAI llm-colosseum issues

OpenGenerativeAI / llm-colosseum

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM

https://huggingface.co/spaces/junior-labs/llm-colosseum

MIT License

1.33k stars 160 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Feat?: Compute Elo Rankings

#70 Jeerhz closed 1 week ago
0
Feat: Add Vision Model to the Game

#69 Jeerhz closed 2 weeks ago
0
Adds back mistral support

#68 oulianov closed 2 months ago
0
Simplify requirements.txt

#67 oulianov closed 2 months ago
0
feat: Add Cerebras API via llama-index

#66 vithursant closed 2 months ago
1
Rename ollama.py to local.py

#65 oulianov closed 3 months ago
0
Adding Dockerfile and docker-compose.yml

#64 harshkasat closed 3 months ago
0
ImportError: cannot import name 'Client' from 'ollama'

#62 nickschuetz closed 3 months ago
1
Ensuring bugfix for pydantic is in place

#61 nickschuetz closed 3 months ago
0
Fighters not fighting

#60 nickschuetz closed 1 month ago
11
feat: Add Bedrock support ⛰️

#59 JGalego closed 3 months ago
0
chore: update dashboard.ipynb

#58 eltociear closed 3 months ago
0
Project no more maintained?

#57 Greatz08 closed 3 months ago
3
🏟️ (9ef4) Error: Wrong rom file for sfiii3n:

#56 sevaroy closed 1 month ago
1
fix typo

#55 zhimin-z closed 4 months ago
0
can't fetch new commit

#54 taozhiyuai closed 3 months ago
1
NEW DOCKER IMAGE ERROR: fighter starts, but two Kens do not fight.

#53 taozhiyuai closed 6 months ago
4
ERROR after upgrade new docker image

#52 taozhiyuai closed 7 months ago
1
ollama bug fix

#51 SamPink closed 7 months ago
0
can not run local model

#50 mengxiyou closed 7 months ago
8
Issue while trying to run locally

#49 edgmin closed 7 months ago
4
Draft: Add solar implementation and video, fix conflict

#48 Tokkiu closed 3 months ago
2
ELO ranking score?

#47 Tokkiu opened 7 months ago
3
[question]Two characters cannot approach each other after they switch positions.

#46 shawokou123 opened 7 months ago
1
Draft: Add solar implementation and video

#45 Tokkiu closed 3 months ago
1
Added support for anthropic and others

#44 SamPink closed 7 months ago
5
Add Google Gemini model

#43 shawokou123 opened 8 months ago
0
How to use Google gemini model

#42 shawokou123 opened 8 months ago
0
Hello, brother. How to modify the program so that AI can play computer controlled characters?

#41 shawokou123 opened 8 months ago
1
Is there a way to set it to do best 3 of 5?

#40 lafintiger opened 8 months ago
3
Yi 6b , no action

#39 taozhiyuai opened 8 months ago
1
how to set show_final=true???

#38 taozhiyuai opened 8 months ago
0
suggestion: add blood in log

#37 taozhiyuai opened 8 months ago
0
KeyError

#36 jgranie closed 8 months ago
3
Report Different models fight on the street

#35 taozhiyuai opened 8 months ago
5
how to change characters?

#34 taozhiyuai opened 8 months ago
4
QWEN 1.8B or less is OK; 4B or more not working

#33 taozhiyuai opened 8 months ago
5
fight in loop

#32 taozhiyuai opened 8 months ago
1
how it learn from history?

#31 taozhiyuai opened 8 months ago
1
larger model, worse peformance?

#30 WSPeng opened 8 months ago
5
Unset API keys are not handled properly

#29 moritz-august closed 8 months ago
3
can I run locally?

#28 taozhiyuai closed 8 months ago
29
.diambra/roms does not exist.

#27 taozhiyuai closed 8 months ago
4
[LLM] Add solar model

#26 Tokkiu closed 8 months ago
5
Adds human controls (Linux only) and simplify code

#25 oulianov closed 8 months ago
2
MacOS only?

#24 Datou closed 8 months ago
2
Update README.md

#23 StanGirard closed 8 months ago
0
Update README.md

#22 Platinn closed 8 months ago
0
super moves & super bar

#21 Platinn closed 8 months ago
0
special moves

#20 Platinn closed 8 months ago
0