search

OpenGenerativeAI / llm-colosseum

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
https://huggingface.co/spaces/junior-labs/llm-colosseum
MIT License
1.34k stars 160 forks source link

Issue while trying to run locally #49

Closed edgmin closed 7 months ago

edgmin commented 7 months ago

Hello! First, thank you for the interesting project! I am trying to run it locally with ollama using an anaconda environment. However, I am getting the following error:

File "\llmtest\llm-colosseum\agent\robot.py", line 135, in plan KeyError: 12 next_buttons_to_press = [ File "\llmtest\llm-colosseum\agent\robot.py", line 138, in for button in META_INSTRUCTIONS_WITH_LOWER[combo][self.current_direction.lower()] KeyError: 6

Context: The game window appears, but the characters do not do anything.

Any idea on what is happening here?

taozhiyuai commented 7 months ago

read all my issues. it is done!

mengxiyou commented 7 months ago

there is a bug maybe. robot.py:290,I changed the code from return [random.choice(list(MOVES.values()))] to return [random.choice(list(META_INSTRUCTIONS_WITH_LOWER.keys())).lower()]

and it works.

taozhiyuai commented 7 months ago

it works for me . no modification is requested.

edgmin commented 7 months ago

there is a bug maybe. robot.py:290,I changed the code from return [random.choice(list(MOVES.values()))] to return [random.choice(list(META_INSTRUCTIONS_WITH_LOWER.keys())).lower()]

and it works.

Thank you! This completely solved my problem!