avast / wanna-ml

Complete MLOps framework for Vertex-AI
MIT License
17 stars 3 forks source link

[FeatureRequest]: validate if we can write to the bucket in profile #99

Open racinmat opened 10 months ago

racinmat commented 10 months ago

Contact Details

matej.racinsky@gendigital.com

Is your feature request related to a problem? Please describe

When there is a bucket in wanna.yaml profile, it does not validate if we can upload data there and the error message does not tell us the name of the bucket. Currently, if we don't have the access to the bucket, it writes:

google.api_core.exceptions.InvalidArgument: 400 could not resolve source: googleapi: Error 403: 755811143150@cloudbuild.gserviceaccount.com does not have storage.objects.get access to the Google Cloud Storage object. Permission 'storage.objects.get' denied on resource (or
 it may not exist)., forbidden

Describe the solution you'd like

document that cloud build needs to read from the bucket, with example of error message and what should people check if they see it

Describe alternatives you've considered

No response

Additional context

in wanna.yaml:


gcp_profiles:
  - profile_name: wanna-test
    project_id: project-from-another-bucket
    zone: europe-west1-b
    bucket: bucket-which-exists-but-without-permissions
    labels:
    network: ...
    subnet: ...
    service_account: ...
    docker_repository: wanna-test