GoogleCloudPlatform / python-docs-samples

Code samples used on cloud.google.com
Apache License 2.0
7.08k stars 6.34k forks source link

Update Gemma on Dataflow example to pass max_length as arg #11897

Open jrmccluskey opened 1 week ago

jrmccluskey commented 1 week ago

Description

Passes the max_length parameter to Gemma's generate() call through inference_args rather than having a hard-coded option.

Checklist

jrmccluskey commented 1 week ago

Got a clean run using this version of the code on a different GCP project since the test runs here have been hitting compute quotas