[ ] Image deployed on dev branch (see notebook and worker dev tags)
[ ] Worker passes manual deployment test on compute.rhg
[ ] Notebook+worker passes test-hub deployment
[ ] Updates integrated into downstream images
Summary
Installs goolge-cloud-sdk and authenticates with service-account-credential on worker if GCLOUD_DEFAULT_TOKEN_FILE environment variable is present on build.
Features
This PR prepares workers to have gsutil -m copy/move and other google sdk commands called from worker processes, allowing workers to take advantage of multithreaded file operations for large numbers of small files.
Workflow
dev
branch (see notebook and worker dev tags)Summary
Installs goolge-cloud-sdk and authenticates with service-account-credential on worker if
GCLOUD_DEFAULT_TOKEN_FILE
environment variable is present on build.Features
gsutil -m
copy/move and other google sdk commands called from worker processes, allowing workers to take advantage of multithreaded file operations for large numbers of small files.