UKGovernmentBEIS / inspect_ai

Inspect: A framework for large language model evaluations
https://UKGovernmentBEIS.github.io/inspect_ai/
MIT License
385 stars 41 forks source link

Typo in _generate_config.py #57

Closed Xodarap closed 1 week ago

Xodarap commented 2 weeks ago

"""Random seed. OpenAI only. OpenAI and Mistral only."""

"OpenAI only" should be removed from here

aisi-inspect commented 1 week ago

Yikes, good catch :-) Will be addressed in the next sync to the public repo.

jjallaire commented 1 week ago

Fixed in latest sync: https://github.com/UKGovernmentBEIS/inspect_ai/commit/210e5fa7d8e07547f99d34ffc1caa3f03dbe8252