hparams key now matched LLM name

carlini / yet-another-applied-llm-benchmark

A benchmark to evaluate language models on questions I've previously asked them to solve.

GNU General Public License v3.0

800 stars 60 forks source link

hparams key now matched LLM name #15

Closed RyanSaxe closed 3 months ago

RyanSaxe commented 3 months ago

I noticed that the hparams in the config file that were being accessed had copy-pasted code that had the wrong llm name. Updated to the right name according to class object.

While I don't know if this is an issue for your tests, as I don't have access to your config file, I imagine it could be a problem.

carlini commented 3 months ago

Thanks!