Closed yonromai closed 1 year ago
Small change to add the model n parameter (to control the number of completions per prompt) to the cache namespace.
n
Reason: I'd like to test the impact of changing the value of n on the metrics of interest without having to manually mess with the cache.
Small change to add the model
nparameter (to control the number of completions per prompt) to the cache namespace.Reason: I'd like to test the impact of changing the value of
non the metrics of interest without having to manually mess with the cache.