apache / superset

Apache Superset is a Data Visualization and Data Exploration Platform
https://superset.apache.org/
Apache License 2.0
60.52k stars 13.07k forks source link

Superset with Athena connection #17182

Open kapilgarg83 opened 2 years ago

kapilgarg83 commented 2 years ago

Hi,

Facing issue in connection with Athena using PyAthena created the connection string

awsathena+rest://{aws_access_key_id}:{aws_secret_access_key}@athena.{region_name}.amazonaws.com/{schema_name}?s3_staging_dir={s3_staging_dir}

Now the problem is {schema_name} parameter is not working Ii am not able to connect to a particular DB or scheme it's always connected to a default data source from my Athena

Kindly suggest

youcefjd commented 2 years ago

Hi kapilgarg83 - can you please explain how you made the connection work? I tried, but I always face an error. I used PyAthena as well. awsathena+rest://@athena.us-east-1.amazonaws.com/?s3_staging_dir=s3://superset-output-workgroup/output-athena/ is my URI, and the error I get is: An error occurred while creating databases: Connection failed, please check your connection settings. I am not using the key/secret key because I am using a role in IAM.

morokin commented 2 years ago

Hi, I can confirm somehow similar behavior. There are multiple datasources configured in our AWS Athena, up on configuring database in superset in a form of:

awsathena+rest://key:secret@athena.us-east-1.amazonaws.com:443/schema?s3_staging_dir=bucket&work_group=some_group

I can successfully establish (test) connection, however when I'm trying to create dataset - Superset showing schemas only from first Athena datasource (AWS Glue) so far I wasn't able to make it choose somehow other Athena datasource

JasbirCodeSpace commented 2 years ago

@kapilgarg83, are you able to solve the problem? facing the same issue here :(

rusackas commented 1 year ago

@eschutho @betodealmeida I can't remember the details, but I know there were some changes/ideas around the Athena connector after this was open. Is this still an issue in your minds?

Curious also if anyone else on the thread is able to repro this in 2.0.1 or on master?

arnoroos-dataroots commented 8 months ago

Same issue here!

rusackas commented 5 months ago

@arnoroos-dataroots what version are you running?

Anyone able to verify this issue on Superset 3.x?

irfanmajeed commented 1 month ago

Same Issue: When test the connection it show "Connection looks good!". When click Connect Button it through error: "An error occurred while creating databases: Database could not be created."

rusackas commented 1 month ago

@irfanmajeed on what version of Superset?

irfanmajeed commented 1 month ago

@irfanmajeed on what version of Superset?

Version: 4.0.0