Open jrmccluskey opened 1 week ago
Passes the max_length parameter to Gemma's generate() call through inference_args rather than having a hard-coded option.
generate()
nox -s py-3.9
nox -s lint
Got a clean run using this version of the code on a different GCP project since the test runs here have been hitting compute quotas
Description
Passes the max_length parameter to Gemma's
generate()
call through inference_args rather than having a hard-coded option.Checklist
nox -s py-3.9
(see Test Environment Setup)nox -s lint
(see Test Environment Setup)