search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
14.88k stars 3.82k forks source link

dbt Cloud Integration problem #39428

Open gurbuzertunga opened 1 month ago

gurbuzertunga commented 1 month ago

Topic

dbt Cloud Integration

Relevant information

I am trying to add a new service token for dbt Cloud Integration but your system keeps throwing errors.http.internalServerError.

I created the dbt account and generated the service token. when pasted, airbyte cloud integrations throws the error.

here is a screenshot as well Screenshot from 2024-06-10 18-41-19

marcosmarxm commented 1 month ago

Thanks @gurbuzertunga I added this to the platform team backlog. If you prefer you can also open a support ticket to get updates about the issue.

timroes commented 1 month ago

@gurbuzertunga Are you running on a region or with a custom URL in dbt Cloud that's not cloud.getdbt.com? If so, this will be the issue, since we currently don't allow you to specify a custom dbt URL. We're currently actively working on enabling this and will have an update available soon that will allow you to specify your custom API endpoint to talk to.

gurbuzertunga commented 1 month ago

@gurbuzertunga Are you running on a region or with a custom URL in dbt Cloud that's not cloud.getdbt.com? If so, this will be the issue, since we currently don't allow you to specify a custom dbt URL. We're currently actively working on enabling this and will have an update available soon that will allow you to specify your custom API endpoint to talk to.

Hi @timroes Thanks for the reply. Yes it seems even though my account is a team account and served from North America servers, it seems it's not being served from cloud.getdbt.com but rather with an account_prefix.us1.dbt.com. I'm trying to see how to translate this account to use cloud.getdbt.com. Any tips would be appreciated!

teallarson commented 1 month ago

If you check the Integrations page again, you should be able to enter that custom access URL now.

gurbuzertunga commented 1 month ago

If you check the Integrations page again, you should be able to enter that custom access URL now.

Hi @teallarson, Just did a test and this time without an error message it doesn't work. see the image below:

image

malikdiarra commented 1 month ago

hi @gurbuzertunga, can you retry by removing the https:// prefix and the trailing /

gurbuzertunga commented 1 month ago

hi @gurbuzertunga, can you retry by removing the https:// prefix and the trailing /

hi @malikdiarra, same error happening. to provide more context I'm sending the api call payload and responses in the screenshots below:

image image

gurbuzertunga commented 3 weeks ago

hi @malikdiarra any updates on this issue?

malikdiarra commented 3 weeks ago

hi @gurbuzertunga, I've got a fix that I'm hoping to ship this week; I'm currently still testing it.