airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.09k stars 4.12k forks source link

Source Hubspot: Hubspot association labels are missing #30292

Open k-schmid opened 1 year ago

k-schmid commented 1 year ago

Connector Name

source-hubspot

Connector Version

1.4.1

What step the error happened?

During the sync

Revelant information

I'm fetching the Hubspot deals using this connector which works quite well in general. What is lacking however, is the labels of the associations, e.g. for companies the "primary" company or other custom labels.

I fells to me, that the primary company is always listed twice in the array. And if there is a second (not primary) company associated with the deal, it is appened. See the following example

id companies
1 ["543", "543"]
2 ["123", "123"]
3 ["345", "345", "789"]

This makes it impossible to filter for the primary company or other custom labels.

Having the raw associations data as an additional column would be great.

Relevant log output

No response

Contribute

k-schmid commented 1 year ago

I've dived a little bit more into the Hubspot API. I think the best would be, to have the associations as an additional stream. This would provide maximal flexibility without much complexity for the user.

Albertbol commented 8 months ago

up!