NVIDIA / garak

the LLM vulnerability scanner
https://discord.gg/uVch4puUCs
Apache License 2.0
2.87k stars 244 forks source link

buff: temperature #103

Open leondz opened 1 year ago

leondz commented 1 year ago

vary the temperature as we request, should be a fine enough one

implemented in ... harness? params that go in the attempt? that the generator extracts?

will require unifying & exposing temperature argument in generator classes. which is fine.

leondz commented 1 year ago

the output from buffs is an attempt stack. can we load generator config params there and process them at execution time?

worth pushing/popping state when doing this - probably only do that with buffed attempts that specify a config change, rather than by default