search

OpenGenerativeAI / llm-colosseum

Benchmark LLMs by fighting in Street Fighter 3! The new way to evaluate the quality of an LLM
https://huggingface.co/spaces/junior-labs/llm-colosseum
MIT License
1.34k stars 160 forks source link

ImportError: cannot import name 'Client' from 'ollama' #62

Closed nickschuetz closed 3 months ago

nickschuetz commented 3 months ago

When running models locally using ollama and utilizing the ollama.py as an input script to diambra it fails with the following error:

ImportError: cannot import name 'Client' from 'ollama' (/home/ken/PROJECTS/llm-colosseum/ollama.py)

If you rename ollama.py to something like local.py and run it that way it works.

Ref: https://github.com/ollama/ollama-python/issues/91#issuecomment-2025819852

oulianov commented 3 months ago

Good catch ! https://github.com/OpenGenerativeAI/llm-colosseum/pull/65