search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.84k stars 4.06k forks source link

[source-hubspot] - Missing updates in deal_property_history stream #46576

Open LucLagrange opened 5 days ago

LucLagrange commented 5 days ago

Connector Name

source-hubspot

Connector Version

4.2.22

What step the error happened?

None

Relevant information

We're using Airbyte (self-hosted) to extract data from our Husbpot instance (private app connection method). The connection runs every two hours.

I am comparing the latest dealstage available for any given deal in the deals_property_history stream against the dealstage value in the deals stream.

There are approx. 250+ deals (out or 3000+) for which the stages do not match.

It seems that the deals_properties_history does not catch some changes (see screenshot of our Hubspot Instance versus the extracted table for the same deal, filtered on dealstage property).

image image

The history stream is set on Incremental | Append mode, with source-defined cursor on the timestamp field.

Relevant log output

No response

Contribute

LucLagrange commented 5 days ago

Here are the logs for the most recent husbpot sync:

679953f8_7136_4249_9c41_84b4df586590_job_4401_attempt_1_txt.txt