Access Token provider - examples?

[qcastel]

Hello !

First, note that I am new to the space and still trying to figuring out things. Please don't hesitate to ask me more details or redirect me to some documentations that I may have missed.

In Dataiku, we would like to allow hadoop to connect to GCS via OAuth2. Looking at your configuration, it seems we need to implement a custom AccessTokenProvider. From that, we got a few questions:

• Have you got an example somewhere that we could use as source of inspiration?
• I did create a new maven project and started implementing this interface AccessTokenProvider. It seems that I can not access to the config, meaning I can't really pass values to my custom AccessTokenProvider. Context: I already got an access token and refresh token from the user, ideally I wanted to somehow pass those tokens, along with the client id and client secret (for the refresh potential), to this custom AccessTokenProvider. My first though was to pass those values as part of the config, something like fs.gs.auth.client.id. Is that possible? What is your suggestion to achieve the same result?
• Is it in your roadmap to support OAuth2 without the need to implement a custom class? We did the same for azure and it was a bit more straight forward I must say. Perhaps you got plan already to support it a bit more natively?
• There is nothing really specific to dataiku that we will implement in this AccessTokenProvider, perhaps we could simply contribute to this project instead? By providing a way to setup OAuth2 without a custom provider? what do you think?

Thanks in advance, any help to achieve an OAuth2 connection to GCS from Hadoop would be welcome!

[medb]

Please take a look at this implementation as an example.

May you elaborate more on your use case, from where/how do you plan to obtain access tokens to access GCS?

[qcastel]

Hello @medb

Apologies for the delay. We made it work on our side at the end, although we noticed that there isn't anything particular to our product in our custom OAuth2 provider. This is why we would be happy to actually contribute our custom OAuth2 provider to the google hadoop connector directly.

It seems to me that the best place was here: https://github.com/GoogleCloudPlatform/gcp-token-broker/pull/39 This give you a better view of what we intended to implement initially.

PS: happy to move the PR to this repo if you prefer and/or change the implement accordingly.

[qcastel]

hello @medb

I spoke to @jphalip today, who suggested me it was best to move this PR to this repo!

Let us know if you find this contribution a good fit for this connector :)