search

OpenGenerativeAI / llm-colosseum

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
https://huggingface.co/spaces/junior-labs/llm-colosseum
MIT License
1.26k stars 143 forks source link

how it learn from history? #31

Open taozhiyuai opened 4 months ago

taozhiyuai commented 4 months ago

since I notice that history.db is fail to create. so How it learn from the past fights to become better?

`🏟️ (eb4e) Fontconfig error: Cannot load default config file

🏟️ (eb4e) Warning: -video none doesn't make much sense without -seconds_to_run

🏟️ (eb4e) ALSA lib conf.c:4553:(snd_config_update_r) Cannot access file /usr/share/alsa/alsa.conf

ALSA lib seq.c:935:(snd_seq_open_noupdate) Unknown SEQ default

🏟️ (eb4e) Unable to create history.db

Unable to create history.db

🏟️ (eb4e) Unable to create history.db `

oulianov commented 4 months ago

For now, it doesn't learn from past fights to become better. But this is a great idea ! The algo could try other prompts through a genetic algorithm, in order to find the best fighting strategy.