os-climate / OS-Climate-Community-Hub

START HERE: OS-Climate Community & Project Collaboration Space
Apache License 2.0
105 stars 18 forks source link

Request credentials for an os-climate bucket #142

Closed jainur closed 1 month ago

jainur commented 9 months ago

Requesting credentials for github user: jainur@gmail.com

Requesting credentials for the bucket: OSC Data Commons and Physical Risk & Resilience

Email address to send a credential download link: jainur@gmail.com

I'm requesting to join the os-c github org and get access to Trino. Currently githubidp authentication on both Open MetaData and Trino JWS token retrieval fails. Please assist with accessing Trino data as part of a member organization.

Request checklist:

strawberry-baked-alaska commented 9 months ago

I sent you an invite to join our github. Once you accept the invite you should be able to gain access.

The keys are stored in openshift, you can login using your github account and should be able to see them here at this URL:

https://console-openshift-console.apps.odh-cl1.apps.os-climate.org/k8s/ns/sandbox/secrets/physrisk-s3-keys

jainur commented 8 months ago

Thank you. I have accepted the invitation and can login to CL 1 and 2.

However, for some reason, access to trino (using notebooks e.,g., https://github.com/os-climate/data-platform-demo/blob/master/notebooks/trino-pandas-demo.ipynb) does not work. How to gain / request this access?

strawberry-baked-alaska commented 8 months ago

@redmikhail or @ModeSevenIndustrialSolutions - can you take a look please?

ModeSevenIndustrialSolutions commented 3 months ago

@jainur Sorry, I didn't see this when it came in and nobody forwarded it to me. I've now setup notifications for this support channel. I'm assuming (after all this time) the access issue got resolved? I'm not familiar with the Notebook setup in data-platform-demo, one of the project leads would probably need to assist. Have you joined the Os-Climate Slack organisation? That's a good place to ask questions and it's potentially easier to get access to some interactive help.

jainur commented 3 months ago

Thanks. I still did not have any luck with Trino access. I will ask this question on Slack.

ModeSevenIndustrialSolutions commented 3 months ago

I have asked a couple of my technical contacts how we go about granting access to Trino. I believe this resides on the OS-Climate RedHat Openshift cluster.

Do you already have a RedHat account? https://redhat.com/ https://sso.redhat.com/auth/realms/redhat-external/account/

I think this is a prerequisite, so perhaps register for one now while you are waiting for me to get back to you?

jainur commented 3 months ago

thank you @ModeSevenIndustrialSolutions . I will try and come back.

jainur commented 2 months ago

Dear @ModeSevenIndustrialSolutions -

Unfortunately, I could not get past the wall. I am doing something stupid, not sure what.

I tried the following:

TRINO_USER=jainur@gmail.com TRINO_PASSWD= <<Token generated using this link>> TRINO_HOST=das-odh-trino.apps.odh-cl2.apps.os-climate.org TRINO_PORT=443

And when I execute the notebook, I get the following error:

image

Not sure what and where things are going wrong.

ModeSevenIndustrialSolutions commented 2 months ago

@redmikhail Any chance you can pick this up, take a look?

redmikhail commented 2 months ago

@jainur My apologies for delay . Trino in this case is using JWT authentication with token generated based on your id. DAS application is just a ui to generate token (please note that token expires)

  1. Use DAS https://das-odh-trino.apps.odh-cl2.apps.os-climate.org/ to generate token (select Github authentincation)
  2. URL for actual trino should be - https://trino-secure-odh-trino.apps.odh-cl2.apps.os-climate.org or trino-secure-odh-trino.apps.odh-cl2.apps.os-climate.org . (DAS is being used to generate token)
  3. Copy generated token and use it with JWT authentication (https://github.com/trinodb/trino-python-client/blob/master/README.md#jwt-authentication) , eg. you just need to provide token _Note:To verify connection you can use curl : curl -k https://trino-secure-odh-trino.apps.odh-cl2.apps.os-climate.org/v1/statement/ \ --header "Authorization: Bearer <your token generated in step 1>" \ --data "select * from default"

Please let me know if you have any issues . You can also ping me on Slack

ModeSevenIndustrialSolutions commented 1 month ago

No response in three weeks? I assume this ticket can be closed. We can re-open, if necessary.

jainur commented 1 month ago

Hi @ModeSevenIndustrialSolutions , the issue is not yet closed. I have reached out to Mikhail on Slack but waiting for his inputs.