Create dbt converter for Airbyte Asana source connector - Githubissues

airbytehq / airbyte-dbt-models

Models to be used to leverage Airbyte output connector data.

MIT License

5 stars 15 forks source link

Create dbt converter for Airbyte Asana source connector #9

Closed marcosmarxm closed 1 month ago

marcosmarxm commented 3 months ago

The goal of this task is to ensure the Airbyte Asana connector output can be used to run Fivetran's dbt analytical model.

Definition of Done:

Create a pull request that adds new tables or views, enabling the execution of Fiventran's dbt with Airbyte output data.
Update the documentation inside the connector folder to explain how to configure the user dbt package to run the analytical model.

Resources:

Check example of how it was done for Zendesk Support connector

pangeran-bottor commented 2 months ago

Hi @marcosmarxm , I would like to take this issue

pangeran-bottor commented 2 months ago

Step 1: Identify what streams

https://github.com/fivetran/dbt_asana_source/blob/main/models/src_asana.yml	Fivetran	Airbyte
project	projects
project_task	tasks
section	sections
story	stories
tag	tags
task	tasks
task_follower	tasks.followers
task_section	task.memberships.section
	(updated this identification at Aug 14th)
task_tag	tasks.tags
team	teams
user	users

Hi @marcosmarxm , please review this. Thank you

marcosmarxm commented 2 months ago

For the task_section @pangeran-bottor you'll need to include a new field in tasks. Today it is missing but there is a object in Tasks endpoint: https://developers.asana.com/reference/tasks Let me know if you need help submitting the PR to add this field to Asana -> Tasks stream.

pangeran-bottor commented 2 months ago

For the task_section @pangeran-bottor you'll need to include a new field in tasks. Today it is missing but there is a object in Tasks endpoint: https://developers.asana.com/reference/tasks Let me know if you need help submitting the PR to add this field to Asana -> Tasks stream.

Got it, I'll take a look on it

pangeran-bottor commented 2 months ago

Hi @marcosmarxm , as I was investigating the connector error (it's working fine now), just found out that section can be extracted from the memberships field. Sorry for missing that. I guess I can proceed to the next steps then?

pangeran-bottor commented 2 months ago

Hi @marcosmarxm , I still haven't got the credentials to the test instance. I just started to do the initial converter for project in this commit. This is the Fivetran staging: https://github.com/fivetran/dbt_asana_source/blob/main/models/stg_asana__project.sql Kindly take a look if this close to what intended. If so, I will apply this for all the models