Support For AWS Athena As Source

[IstvanM]

Description

Support for Athena

What problem does this solve?

Many startups don't have the budget to run Databricks or Snowflake as their Data Lake solution. Athena is currently the cheapest on the market.

[TuringLovesDeathMetal]

Hey @IstvanM thanks for opening this issue!

We only support verified dbt adapters for now. You can find the list of verified adapters here: https://docs.getdbt.com/docs/supported-data-platforms#verified-adapters

Once Athena gets onto that list, we'll definitely work on adding support for it in Lightdash!

[TuringLovesDeathMetal]

@all-contributors add @IstvanM for ideas

[allcontributors[bot]]

@TuringLovesDeathMetal

I've put up a pull request to add @IstvanM! :tada:

[IstvanM]

Thank you very much!!! This is great!!! Sorry I was not responding fast enough

🚀 🚀 🚀

[stale[bot]]

Is this issue still relevant? There have been no updates for 60 days, please close the issue or keep the conversation going!

[jankatins]

Still relevant

[nicor88]

The only blocker to make this happen is the verification of dbt-athena-community (the adapter with the most recent version of dbt).

Related to https://github.com/dbt-labs/dbt-core/discussions/7286 Specifically, the process of verifying a community-based adapter seems a bit unclear.

[stale[bot]]

Is this issue still relevant? There have been no updates for 60 days, please close the issue or keep the conversation going!

[mrshu]

@nicor88 I guess the verification procedure has been settled now somewhat?

https://docs.getdbt.com/guides/dbt-ecosystem/adapter-development/7-verifying-a-new-adapter

[nicor88]

@mrshu the verification process is still quite unclear, as in the case of athena the adapter is community based - and all the verified adapters (e.g. see trino), have a company behind.

[stale[bot]]

Is this issue still relevant? There have been no updates for 60 days, please close the issue or keep the conversation going!

[mrshu]

Thanks @nicor88. Would you estimate it might ever happen?

[nicor88]

@mrshu Based on the conversations that I had with dbt seems like a dbt community adapter cannot be verified. Still, they are in the process of considering adding trusted adapters - that means that if Lightdash consider the support of "trusted" adapters and if dbt-athena becomes a trusted adapter, then this integration will be possible.

[nicor88]

@TuringLovesDeathMetal dbt-athena-community became a trusted adapter: https://docs.getdbt.com/docs/trusted-adapters wondering if you plan to support not only verified but also trusted adapters.

cc @owlas

[darkcofy]

would love to have this integration, would make lightdash an easy choice for us if it works with athena

[amartinezcortizas]

One more, would love to have the chance of testing lightdash with athena

[ankit-shopflo]

+1 would love to use lightdash with Athena

[SOVALINUX]

Would love also to upvote the Athena adapter