skyplane-project / skyplane

🔥 Blazing fast bulk data transfers between any cloud 🔥
https://skyplane.org
Apache License 2.0
1k stars 58 forks source link

[bug] GCP Service Account Issues #832

Open sarahwooders opened 1 year ago

sarahwooders commented 1 year ago

Describe the bug The user is transferring data between GCP and AWS. However, the gateways are unable to authenticate with the service account. Strangely, the Skyplane is still able to list files locally.

Gateway Logs If applicable, add screenshots to help explain your problem.

2023-05-03T20:28:24.999685680Z 20:28:24 [DEBUG]  Start download 83546e97436b428b8a5b87b8b36a2fc2 from 
2023-05-03T20:28:24.999700183Z bg-ga-sessions
2023-05-03T20:28:24.999702889Z 20:28:24 [DEBUG]  Start download bc79b6910a6242458d92e6429f8d14d5 from 
2023-05-03T20:28:24.999705242Z bg-ga-sessions
2023-05-03T20:28:25.000716950Z 20:28:24 [WARN]   ObjectStoreInterface not cached for 
2023-05-03T20:28:25.000727780Z gcp:us-central1-a:bg-ga-sessions
2023-05-03T20:28:25.000729950Z 20:28:24 [WARN]   ObjectStoreInterface not cached for 
2023-05-03T20:28:25.000731570Z gcp:us-central1-a:bg-ga-sessions
2023-05-03T20:28:25.265717341Z 127.0.0.1 - - [03/May/2023 20:28:25] "GET /api/v1/errors HTTP/1.1" 200 -
2023-05-03T20:28:25.312896915Z 20:28:25 [ERROR]  Exception: Failed to create obj store interface <HttpError 403
2023-05-03T20:28:25.312916035Z when requesting 
2023-05-03T20:28:25.312917827Z https://iam.googleapis.com/v1/projects/<project>/serviceAccounts?alt=json 
2023-05-03T20:28:25.312919424Z returned "Caller does not have required permission to use project 
2023-05-03T20:28:25.312920915Z <project>. Grant the caller the roles/serviceusage.serviceUsageConsumer 
2023-05-03T20:28:25.312922445Z role, or a custom role with the serviceusage.services.use permission, by 
2023-05-03T20:28:25.312923928Z visiting 
2023-05-03T20:28:25.312925368Z https://console.developers.google.com/iam-admin/iam/project?project=<project>
2023-05-03T20:28:25.312926884Z and then retry. Propagation of the new permission may take a few minutes.". 
2023-05-03T20:28:25.312928344Z Details: "[{'@type': 'type.googleapis.com/google.rpc.Help', 'links': 
2023-05-03T20:28:25.312929717Z [{'description': 'Google developer console IAM admin', 'url': 
2023-05-03T20:28:25.312931572Z 'https://console.developers.google.com/iam-admin/iam/project?project=<project>
2023-05-03T20:28:25.312932964Z '}]}, {'@type': 'type.googleapis.com/google.rpc.ErrorInfo', 'reason': 
2023-05-03T20:28:25.312934368Z 'USER_PROJECT_DENIED', 'domain': 'googleapis.com', 'metadata': {'consumer': 
2023-05-03T20:28:25.312935828Z 'projects/<project>', 'service': 'iam.googleapis.com'}}]">

Environment info (please complete the following information):