search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.3k stars 3.95k forks source link

HubSpot Sync Job Hangs on engagements Sync #11252

Closed ghost closed 2 years ago

ghost commented 2 years ago

Environment

Current Behavior

Airbyte sync hangs on Syncing stream: engagements, syncs succeed without engagements

Expected Behavior

Airbyte should sync engagements from HubSpot

Logs

If applicable, please upload the logs from the failing operation. For sync jobs, you can download the full logs from the UI by going to the sync attempt page and clicking the download logs button at the top right of the logs display window.

LOG ``` 2022-03-17 15:46:47 INFO i.a.w.w.WorkerRun(call):49 - Executing worker wrapper. Airbyte version: 0.35.55-alpha 2022-03-17 15:46:48 INFO i.a.w.t.TemporalAttemptExecution(get):105 - Docker volume job log path: /tmp/workspace/394/0/logs.log 2022-03-17 15:46:48 INFO i.a.w.t.TemporalAttemptExecution(get):110 - Executing worker wrapper. Airbyte version: 0.35.55-alpha 2022-03-17 15:46:48 INFO i.a.w.DefaultReplicationWorker(run):104 - start sync worker. job id: 394 attempt id: 0 2022-03-17 15:46:48 INFO i.a.w.DefaultReplicationWorker(run):116 - configured sync modes: {null.engagements=full_refresh - append} 2022-03-17 15:46:48 INFO i.a.w.p.a.DefaultAirbyteDestination(start):69 - Running destination... 2022-03-17 15:46:48 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/destination-bigquery:0.6.11 exists... 2022-03-17 15:46:48 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/destination-bigquery:0.6.11 was found locally. 2022-03-17 15:46:48 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 394 2022-03-17 15:46:48 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/394/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_CONNECTOR_IMAGE=airbyte/destination-bigquery:0.6.11 -e WORKER_JOB_ATTEMPT=0 -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.35.55-alpha -e WORKER_JOB_ID=394 airbyte/destination-bigquery:0.6.11 write --config destination_config.json --catalog destination_catalog.json 2022-03-17 15:46:48 INFO i.a.c.i.LineGobbler(voidCall):82 - Checking if airbyte/source-hubspot:0.1.48 exists... 2022-03-17 15:46:48 INFO i.a.c.i.LineGobbler(voidCall):82 - airbyte/source-hubspot:0.1.48 was found locally. 2022-03-17 15:46:48 INFO i.a.w.p.DockerProcessFactory(create):106 - Creating docker job ID: 394 2022-03-17 15:46:48 INFO i.a.w.p.DockerProcessFactory(create):158 - Preparing command: docker run --rm --init -i -w /data/394/0 --log-driver none --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e WORKER_CONNECTOR_IMAGE=airbyte/source-hubspot:0.1.48 -e WORKER_JOB_ATTEMPT=0 -e WORKER_ENVIRONMENT=DOCKER -e AIRBYTE_ROLE= -e AIRBYTE_VERSION=0.35.55-alpha -e WORKER_JOB_ID=394 airbyte/source-hubspot:0.1.48 read --config source_config.json --catalog source_catalog.json --state input_state.json 2022-03-17 15:46:48 INFO i.a.w.DefaultReplicationWorker(lambda$getDestinationOutputRunnable$6):339 - Destination output thread started. 2022-03-17 15:46:48 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):279 - Replication thread started. 2022-03-17 15:46:48 INFO i.a.w.DefaultReplicationWorker(run):158 - Waiting for source and destination threads to complete. 2022-03-17 15:46:49 destination > SLF4J: Class path contains multiple SLF4J bindings. 2022-03-17 15:46:49 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-03-17 15:46:49 destination > SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class] 2022-03-17 15:46:49 destination > SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. 2022-03-17 15:46:49 destination > SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory] 2022-03-17 15:46:50 source > Starting syncing SourceHubspot 2022-03-17 15:46:50 source > Syncing stream: engagements 2022-03-17 15:46:51 destination > 2022-03-17 15:46:51 INFO i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json} 2022-03-17 15:46:51 destination > 2022-03-17 15:46:51 INFO i.a.i.b.IntegrationRunner(run):103 - Sentry transaction event: b34f6aa35ad44d8cb67e420f77e06080 2022-03-17 15:46:51 destination > 2022-03-17 15:46:51 INFO i.a.i.b.IntegrationRunner(runInternal):121 - Running integration: io.airbyte.integrations.destination.bigquery.BigQueryDestination 2022-03-17 15:46:51 destination > 2022-03-17 15:46:51 INFO i.a.i.b.IntegrationRunner(runInternal):122 - Command: WRITE 2022-03-17 15:46:51 destination > 2022-03-17 15:46:51 INFO i.a.i.b.IntegrationRunner(runInternal):123 - Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'} 2022-03-17 15:46:51 destination > 2022-03-17 15:46:51 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-03-17 15:46:51 destination > 2022-03-17 15:46:51 WARN c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword 2022-03-17 15:46:52 destination > 2022-03-17 15:46:52 INFO i.a.i.d.b.BigQueryUtils(getLoadingMethod):283 - Selected loading method is set to: STANDARD 2022-03-17 15:46:54 destination > 2022-03-17 15:46:54 INFO i.a.i.d.b.BigQueryUtils(createPartitionedTable):123 - Partitioned Table: GenericData{classInfo=[datasetId, projectId, tableId], {datasetId=hubspot, tableId=_airbyte_tmp_qzq_engagements}} created successfully 2022-03-17 15:47:01 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 1000 (8 MB) 2022-03-17 15:47:09 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 2000 (17 MB) 2022-03-17 15:47:18 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 3000 (25 MB) 2022-03-17 15:47:28 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 4000 (34 MB) 2022-03-17 15:47:35 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 5000 (43 MB) 2022-03-17 15:47:42 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 6000 (51 MB) 2022-03-17 15:47:49 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 7000 (60 MB) 2022-03-17 15:47:58 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 8000 (68 MB) 2022-03-17 15:48:06 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 9000 (77 MB) 2022-03-17 15:48:14 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 10000 (86 MB) 2022-03-17 15:48:22 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 11000 (94 MB) 2022-03-17 15:48:29 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 12000 (103 MB) 2022-03-17 15:48:36 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 13000 (111 MB) 2022-03-17 15:48:44 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 14000 (120 MB) 2022-03-17 15:48:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 15000 (129 MB) 2022-03-17 15:48:59 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 16000 (137 MB) 2022-03-17 15:49:08 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 17000 (146 MB) 2022-03-17 15:49:15 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 18000 (154 MB) 2022-03-17 15:49:22 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 19000 (163 MB) 2022-03-17 15:49:31 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 20000 (172 MB) 2022-03-17 15:49:37 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 21000 (180 MB) 2022-03-17 15:49:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 22000 (189 MB) 2022-03-17 15:49:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 23000 (197 MB) 2022-03-17 15:49:58 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 24000 (206 MB) 2022-03-17 15:50:06 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 25000 (215 MB) 2022-03-17 15:50:12 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 26000 (223 MB) 2022-03-17 15:50:19 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 27000 (232 MB) 2022-03-17 15:50:27 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 28000 (240 MB) 2022-03-17 15:50:35 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 29000 (249 MB) 2022-03-17 15:50:43 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 30000 (258 MB) 2022-03-17 15:50:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 31000 (266 MB) 2022-03-17 15:51:00 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 32000 (275 MB) 2022-03-17 15:51:09 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 33000 (283 MB) 2022-03-17 15:51:16 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 34000 (292 MB) 2022-03-17 15:51:25 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 35000 (301 MB) 2022-03-17 15:51:34 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 36000 (309 MB) 2022-03-17 15:51:41 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 37000 (318 MB) 2022-03-17 15:51:49 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 38000 (327 MB) 2022-03-17 15:51:57 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 39000 (335 MB) 2022-03-17 15:52:05 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 40000 (344 MB) 2022-03-17 15:52:14 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 41000 (352 MB) 2022-03-17 15:52:22 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 42000 (361 MB) 2022-03-17 15:52:30 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 43000 (370 MB) 2022-03-17 15:52:37 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 44000 (378 MB) 2022-03-17 15:52:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 45000 (387 MB) 2022-03-17 15:52:53 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 46000 (395 MB) 2022-03-17 15:53:00 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 47000 (404 MB) 2022-03-17 15:53:08 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 48000 (413 MB) 2022-03-17 15:53:16 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 49000 (421 MB) 2022-03-17 15:53:24 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 50000 (430 MB) 2022-03-17 15:53:32 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 51000 (438 MB) 2022-03-17 15:53:39 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 52000 (447 MB) 2022-03-17 15:53:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 53000 (456 MB) 2022-03-17 15:53:53 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 54000 (464 MB) 2022-03-17 15:53:59 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 55000 (473 MB) 2022-03-17 15:54:08 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 56000 (481 MB) 2022-03-17 15:54:16 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 57000 (490 MB) 2022-03-17 15:54:25 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 58000 (499 MB) 2022-03-17 15:54:33 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 59000 (507 MB) 2022-03-17 15:54:40 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 60000 (516 MB) 2022-03-17 15:54:48 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 61000 (524 MB) 2022-03-17 15:54:55 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 62000 (533 MB) 2022-03-17 15:55:02 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 63000 (542 MB) 2022-03-17 15:55:09 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 64000 (550 MB) 2022-03-17 15:55:17 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 65000 (559 MB) 2022-03-17 15:55:26 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 66000 (567 MB) 2022-03-17 15:55:33 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 67000 (576 MB) 2022-03-17 15:55:41 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 68000 (585 MB) 2022-03-17 15:55:49 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 69000 (593 MB) 2022-03-17 15:55:55 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 70000 (602 MB) 2022-03-17 15:56:03 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 71000 (610 MB) 2022-03-17 15:56:13 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 72000 (619 MB) 2022-03-17 15:56:20 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 73000 (628 MB) 2022-03-17 15:56:28 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 74000 (636 MB) 2022-03-17 15:56:37 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 75000 (645 MB) 2022-03-17 15:56:44 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 76000 (654 MB) 2022-03-17 15:56:54 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 77000 (662 MB) 2022-03-17 15:57:00 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 78000 (671 MB) 2022-03-17 15:57:10 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 79000 (679 MB) 2022-03-17 15:57:18 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 80000 (688 MB) 2022-03-17 15:57:26 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 81000 (697 MB) 2022-03-17 15:57:33 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 82000 (705 MB) 2022-03-17 15:57:41 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 83000 (714 MB) 2022-03-17 15:57:48 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 84000 (722 MB) 2022-03-17 15:57:54 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 85000 (731 MB) 2022-03-17 15:58:01 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 86000 (740 MB) 2022-03-17 15:58:08 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 87000 (748 MB) 2022-03-17 15:58:16 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 88000 (757 MB) 2022-03-17 15:58:23 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 89000 (765 MB) 2022-03-17 15:58:29 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 90000 (774 MB) 2022-03-17 15:58:36 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 91000 (783 MB) 2022-03-17 15:58:44 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 92000 (791 MB) 2022-03-17 15:58:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 93000 (800 MB) 2022-03-17 15:59:00 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 94000 (808 MB) 2022-03-17 15:59:08 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 95000 (817 MB) 2022-03-17 15:59:16 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 96000 (826 MB) 2022-03-17 15:59:24 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 97000 (834 MB) 2022-03-17 15:59:31 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 98000 (843 MB) 2022-03-17 15:59:39 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 99000 (851 MB) 2022-03-17 15:59:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 100000 (860 MB) 2022-03-17 15:59:53 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 101000 (869 MB) 2022-03-17 16:00:01 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 102000 (877 MB) 2022-03-17 16:00:09 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 103000 (886 MB) 2022-03-17 16:00:17 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 104000 (894 MB) 2022-03-17 16:00:23 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 105000 (903 MB) 2022-03-17 16:00:30 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 106000 (912 MB) 2022-03-17 16:00:38 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 107000 (920 MB) 2022-03-17 16:00:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 108000 (929 MB) 2022-03-17 16:00:54 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 109000 (938 MB) 2022-03-17 16:01:02 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 110000 (946 MB) 2022-03-17 16:01:10 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 111000 (955 MB) 2022-03-17 16:01:19 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 112000 (963 MB) 2022-03-17 16:01:27 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 113000 (972 MB) 2022-03-17 16:01:35 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 114000 (981 MB) 2022-03-17 16:01:43 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 115000 (989 MB) 2022-03-17 16:01:51 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 116000 (998 MB) 2022-03-17 16:01:58 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 117000 (1006 MB) 2022-03-17 16:02:05 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 118000 (1015 MB) 2022-03-17 16:02:14 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 119000 (1 GB) 2022-03-17 16:02:23 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 120000 (1 GB) 2022-03-17 16:02:32 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 121000 (1 GB) 2022-03-17 16:02:39 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 122000 (1 GB) 2022-03-17 16:02:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 123000 (1 GB) 2022-03-17 16:02:56 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 124000 (1 GB) 2022-03-17 16:03:03 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 125000 (1 GB) 2022-03-17 16:03:10 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 126000 (1 GB) 2022-03-17 16:03:17 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 127000 (1 GB) 2022-03-17 16:03:25 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 128000 (1 GB) 2022-03-17 16:03:32 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 129000 (1 GB) 2022-03-17 16:03:41 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 130000 (1 GB) 2022-03-17 16:03:49 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 131000 (1 GB) 2022-03-17 16:03:56 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 132000 (1 GB) 2022-03-17 16:04:06 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 133000 (1 GB) 2022-03-17 16:04:15 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 134000 (1 GB) 2022-03-17 16:04:26 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 135000 (1 GB) 2022-03-17 16:04:33 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 136000 (1 GB) 2022-03-17 16:04:44 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 137000 (1 GB) 2022-03-17 16:04:51 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 138000 (1 GB) 2022-03-17 16:04:57 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 139000 (1 GB) 2022-03-17 16:05:05 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 140000 (1 GB) 2022-03-17 16:05:12 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 141000 (1 GB) 2022-03-17 16:05:21 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 142000 (1 GB) 2022-03-17 16:05:29 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 143000 (1 GB) 2022-03-17 16:05:36 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 144000 (1 GB) 2022-03-17 16:05:47 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 145000 (1 GB) 2022-03-17 16:05:56 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 146000 (1 GB) 2022-03-17 16:06:07 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 147000 (1 GB) 2022-03-17 16:06:18 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 148000 (1 GB) 2022-03-17 16:06:26 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 149000 (1 GB) 2022-03-17 16:06:35 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 150000 (1 GB) 2022-03-17 16:06:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 151000 (1 GB) 2022-03-17 16:06:54 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 152000 (1 GB) 2022-03-17 16:07:03 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 153000 (1 GB) 2022-03-17 16:07:14 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 154000 (1 GB) 2022-03-17 16:07:23 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 155000 (1 GB) 2022-03-17 16:07:30 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 156000 (1 GB) 2022-03-17 16:07:38 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 157000 (1 GB) 2022-03-17 16:07:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 158000 (1 GB) 2022-03-17 16:07:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 159000 (1 GB) 2022-03-17 16:07:59 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 160000 (1 GB) 2022-03-17 16:08:08 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 161000 (1 GB) 2022-03-17 16:08:16 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 162000 (1 GB) 2022-03-17 16:08:24 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 163000 (1 GB) 2022-03-17 16:08:31 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 164000 (1 GB) 2022-03-17 16:08:38 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 165000 (1 GB) 2022-03-17 16:08:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 166000 (1 GB) 2022-03-17 16:08:53 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 167000 (1 GB) 2022-03-17 16:09:00 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 168000 (1 GB) 2022-03-17 16:09:08 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 169000 (1 GB) 2022-03-17 16:09:15 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 170000 (1 GB) 2022-03-17 16:09:23 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 171000 (1 GB) 2022-03-17 16:09:31 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 172000 (1 GB) 2022-03-17 16:09:39 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 173000 (1 GB) 2022-03-17 16:09:46 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 174000 (1 GB) 2022-03-17 16:09:53 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 175000 (1 GB) 2022-03-17 16:09:59 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 176000 (1 GB) 2022-03-17 16:10:08 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 177000 (1 GB) 2022-03-17 16:10:15 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 178000 (1 GB) 2022-03-17 16:10:23 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 179000 (1 GB) 2022-03-17 16:10:30 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 180000 (1 GB) 2022-03-17 16:10:37 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 181000 (1 GB) 2022-03-17 16:10:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 182000 (1 GB) 2022-03-17 16:10:53 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 183000 (1 GB) 2022-03-17 16:11:00 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 184000 (1 GB) 2022-03-17 16:11:09 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 185000 (1 GB) 2022-03-17 16:11:16 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 186000 (1 GB) 2022-03-17 16:11:23 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 187000 (1 GB) 2022-03-17 16:11:30 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 188000 (1 GB) 2022-03-17 16:11:38 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 189000 (1 GB) 2022-03-17 16:11:45 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 190000 (1 GB) 2022-03-17 16:11:52 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 191000 (1 GB) 2022-03-17 16:11:58 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 192000 (1 GB) 2022-03-17 16:12:06 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 193000 (1 GB) 2022-03-17 16:12:12 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 194000 (1 GB) 2022-03-17 16:12:19 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 195000 (1 GB) 2022-03-17 16:12:27 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 196000 (1 GB) 2022-03-17 16:12:35 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 197000 (1 GB) 2022-03-17 16:12:42 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 198000 (1 GB) 2022-03-17 16:12:49 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 199000 (1 GB) 2022-03-17 16:12:57 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 200000 (1 GB) 2022-03-17 16:13:05 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 201000 (1 GB) 2022-03-17 16:13:11 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 202000 (1 GB) 2022-03-17 16:13:18 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 203000 (1 GB) 2022-03-17 16:13:26 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 204000 (1 GB) 2022-03-17 16:13:33 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 205000 (1 GB) 2022-03-17 16:13:42 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 206000 (1 GB) 2022-03-17 16:13:50 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 207000 (1 GB) 2022-03-17 16:13:57 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 208000 (1 GB) 2022-03-17 16:14:05 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 209000 (1 GB) 2022-03-17 16:14:13 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 210000 (1 GB) 2022-03-17 16:14:21 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 211000 (1 GB) 2022-03-17 16:14:27 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 212000 (1 GB) 2022-03-17 16:14:33 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 213000 (1 GB) 2022-03-17 16:14:39 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 214000 (1 GB) 2022-03-17 16:14:44 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 215000 (1 GB) 2022-03-17 16:14:49 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 216000 (1 GB) 2022-03-17 16:14:55 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 217000 (1 GB) 2022-03-17 16:15:00 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 218000 (1 GB) 2022-03-17 16:15:05 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 219000 (1 GB) 2022-03-17 16:15:10 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 220000 (1 GB) 2022-03-17 16:15:15 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 221000 (1 GB) 2022-03-17 16:15:18 source > Backing off _send(...) for 5.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException) 2022-03-17 16:15:24 source > Caught retryable error '' after 1 tries. Waiting 5 seconds then retrying... 2022-03-17 16:15:25 source > Backing off _send(...) for 5.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException) 2022-03-17 16:15:31 source > Caught retryable error '' after 1 tries. Waiting 5 seconds then retrying... 2022-03-17 16:15:34 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 222000 (1 GB) [...] 2022-03-18 08:52:21 INFO i.a.w.DefaultReplicationWorker(lambda$getReplicationRunnable$5):301 - Records read: 10184000 (85 GB) ```

Steps to Reproduce

1.Setup HubSpot source with API key and engagements as an input 2.Setup BigQuery destination 3.Run a sync job

Are you willing to submit a PR?

Yes

ghost commented 2 years ago

Similar to https://github.com/airbytehq/airbyte/issues/10544

FilipeAraujo commented 2 years ago

I'm having a different issue, but also around engagements.

I have 320k engagements in hubspot but while importing it can reach like 32M rows (with duplicates) of data, is that normal? I tried to divide the import into two connections, one with only engagements and the other with all except engagements, the result is the same AND the result of the tables without engagements I've got:

2022-03-18 17:52:48 source > Syncing stream: marketing_emails 
2022-03-18 17:52:51 source > Read 250 records from marketing_emails stream
2022-03-18 17:52:51 source > Finished syncing SourceHubspot
2022-03-18 17:52:51 source > SourceHubspot runtimes:
2022-03-18 17:52:51 source > Syncing stream: owners 
2022-03-18 17:52:51 source > Read 37 records from owners stream
2022-03-18 17:52:51 source > Finished syncing SourceHubspot
2022-03-18 17:52:51 source > SourceHubspot runtimes:
2022-03-18 17:52:51 source > Syncing stream: products 
2022-03-18 17:52:51 source > Advancing bookmark for products stream from None to 2022-02-22T10:57:58.575000+00:00
2022-03-18 17:52:51 source > Read 1 records from products stream
2022-03-18 17:52:51 source > Finished syncing SourceHubspot
2022-03-18 17:52:51 source > SourceHubspot runtimes:
2022-03-18 17:52:51 source > Syncing stream: property_history 
2022-03-18 18:31:42 source > Backing off _send(...) for 5.0s (airbyte_cdk.sources.streams.http.exceptions.DefaultBackoffException)

And it's stuck there forever. If you need more details I can add them.

Thanks.

ghost commented 2 years ago

@FilipeAraujo I think it's the same issue, I am pulling million of rows even if I only have 600k engagements.

FilipeAraujo commented 2 years ago

@matfiorlh I think this is related https://github.com/airbytehq/airbyte/pull/11266, hope someone approves it and releases it.

ghost commented 2 years ago

That's likely, thanks for pointing it out.

FilipeAraujo commented 2 years ago

@matfiorlh I think the fix has been released (0.1.50), I'm testing, can you please test? and maybe close this issue?

ghost commented 2 years ago

Of course, will do right now.

ghost commented 2 years ago

It works, I'll close the issue.