only set generations if still default - Githubissues

leondz / garak

LLM vulnerability scanner

https://discord.gg/uVch4puUCs

Apache License 2.0

1.03k stars 120 forks source link

only set generations if still default #741

Closed jmartin-tech closed 1 week ago

jmartin-tech commented 1 week ago

When generations is set via config ignore the constructor provided value.

Planned revision to Generator will remove generations from the constructor furher ensuring the value is default or supplied on a config_root.

only set self.generations if still matches default
expand Cohere defaults to include Generator defaults
restore test_attempts line selection with note about why the line is correct