OpenGenerativeAI / llm-colosseum

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
https://huggingface.co/spaces/junior-labs/llm-colosseum
MIT License
1.34k stars 160 forks source link

how to change characters? #34

Open taozhiyuai opened 8 months ago

taozhiyuai commented 8 months ago

it seems Qwen 0.5B is better model to run. by the way, how to change characters?

Alex, Twelve, Hugo, Sean, Makoto, Elena, Ibuki, Chun-Li, Dudley, Necro, Q, Oro, Urien, Remy, Ryu, Gouki, Yun, Yang, Ken

oulianov commented 8 months ago

There is a way to change characters, but it's not easy right now

  1. You need to change the Diambra parameters here

    Capture d’écran 2024-04-01 à 09 00 07
  2. You need to change the "character color" and "enemy color". That's how we know character position : by looking at the pixels of this color.

  3. You need to edit the moves in config.py so that the special moves of each character is properly mapped.

With better configuration, this could be easier to do, but that was not a priority for now

Suenynis commented 8 months ago

Wow this is awesome project

taozhiyuai commented 8 months ago

There is a way to change characters, but it's not easy right now

  1. You need to change the Diambra parameters here
Capture d’écran 2024-04-01 à 09 00 07
  1. You need to change the "character color" and "enemy color". That's how we know character position : by looking at the pixels of this color.
  2. You need to edit the moves in config.py so that the special moves of each character is properly mapped.

With better configuration, this could be easier to do, but that was not a priority for now

it is not easy for me to modify files.

oulianov commented 8 months ago

You should download VS Code and learn some more python ! It's not easy but it's worth it. You'll be able to do this and much more.