coiled / dask-bigquery

BSD 3-Clause "New" or "Revised" License
43 stars 13 forks source link

Explain user vs service account credentials #60

Closed ntabris closed 1 year ago

ntabris commented 1 year ago

I think for many users running code locally, they might not want to go through the hassle of making a service account, so let's explain how to use gcloud with their user creds.

ntabris commented 1 year ago

fyi @ncclementi @j-bennet this explains how to authenticate without making a service account.

j-bennet commented 1 year ago

@ntabris Have you verified that this works for read/write use case?

ntabris commented 1 year ago

@ntabris Have you verified that this works for read/write use case?

Yes

ncclementi commented 1 year ago

Just a heads up, I tried to do this with python 3.10 in the environment and it didn't work. had to use python 3.9 to be able to run $ gcloud auth application-default login

bnaul commented 1 year ago

we are on 3.10 and gcloud auth application-default login works for me 🤔

ncclementi commented 1 year ago

@j-bennet and I were looking into it. It looks like there is also a gcsfs issue. I was able to make the reading using application-default login without a service account, but can't make the writing work, there is some problem with passing the token.

j-bennet commented 1 year ago

Naty opened an issue in gcsfs: https://github.com/fsspec/gcsfs/issues/553