search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
15.52k stars 4k forks source link

[source-bigquery] Getting data to sync is really slow #45119

Open afillatre opened 2 weeks ago

afillatre commented 2 weeks ago

Connector Name

source-bigquery

Connector Version

0.4.2

What step the error happened?

During the sync

Relevant information

The connector takes more than 40min to sync 1M rows (~150Mo), because it gets the data by chucks of 10 000 rows, and waiting a lot between chunks.

Relevant log output

2024-09-04 06:28:18 replication-orchestrator > Stream status TRACE received of status: RUNNING for stream data_platform_gold:view_agg_users_lvl1_favourite_categories
2024-09-04 06:28:19 replication-orchestrator > Records read: 5000 (655 KB)
2024-09-04 06:28:27 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 10000
2024-09-04 06:28:27 replication-orchestrator > Records read: 10000 (1 MB)

[...]

2024-09-04 07:09:03 replication-orchestrator > Records read: 1025000 (132 MB)
2024-09-04 07:09:18 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 1030000
2024-09-04 07:09:18 replication-orchestrator > Records read: 1030000 (133 MB)
2024-09-04 07:09:18 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$read$1):184 Closing database connection pool.
2024-09-04 07:09:18 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$read$1):186 Closed database connection pool.
2024-09-04 07:09:18 source > INFO i.a.c.i.b.IntegrationRunner(runInternal):231 Completed integration: io.airbyte.integrations.source.bigquery.BigQuerySource

Contribute

marcosmarxm commented 2 weeks ago

Do you mind sharing the complete sync log @afillatre ?

afillatre commented 2 weeks ago

Sure ! The job did not finish correctly (I have another issue opened for that), but the log shows the source part fully.

2024-09-04 06:27:05 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: CLAIM — (workloadId = bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:14 INFO i.a.c.ConnectorWatcher(run):90 - Output file jobOutput.json found
2024-09-04 06:27:14 INFO i.a.c.i.LineGobbler(voidCall):166 - ----- START CHECK -----
2024-09-04 06:27:14 INFO i.a.c.i.LineGobbler(voidCall):166 - 
2024-09-04 06:27:14 INFO i.a.c.ConnectorWatcher(run):96 - Connector exited with 0
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):189 - Reading messages from protocol version 0.2.0
2024-09-04 06:27:14 WARN i.a.m.l.MetricClientFactory(getMetricClient):43 - MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics.
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.s.b.BigQuerySource(main):219 starting source: class io.airbyte.integrations.source.bigquery.BigQuerySource
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.c.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=/config/connectionConfiguration.json}
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.c.i.b.IntegrationRunner(runInternal):132 Running integration: io.airbyte.integrations.source.bigquery.BigQuerySource
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.c.i.b.IntegrationRunner(runInternal):133 Command: CHECK
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.c.i.b.IntegrationRunner(runInternal):134 Integration config: IntegrationConfig{command=CHECK, configPath='/config/connectionConfiguration.json', catalogPath='null', statePath='null'}
2024-09-04 06:27:14 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):305 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.s.b.BigQuerySource(lambda$getCheckOperations$0):90 The source passed the basic query test!
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.s.b.BigQuerySource(lambda$getCheckOperations$1):99 The Dataset query test is skipped due to not configured datasetId!
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.c.i.b.IntegrationRunner(runInternal):231 Completed integration: io.airbyte.integrations.source.bigquery.BigQuerySource
2024-09-04 06:27:14 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.s.b.BigQuerySource(main):221 completed source: class io.airbyte.integrations.source.bigquery.BigQuerySource
2024-09-04 06:27:14 INFO i.a.c.ConnectorMessageProcessor(updateConfigFromControlMessage):231 - Checking for optional control message...
2024-09-04 06:27:14 INFO i.a.c.ConnectorWatcher(run):134 - Writing output of bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check to the doc store
2024-09-04 06:27:14 INFO i.a.c.ConnectorWatcher(run):136 - Marking workload as successful
2024-09-04 06:27:14 INFO i.a.c.ConnectorWatcher(exitProperly):189 - Deliberately exiting process with code 0.
2024-09-04 06:27:14 INFO i.a.c.i.LineGobbler(voidCall):166 - 
2024-09-04 06:27:14 INFO i.a.c.i.LineGobbler(voidCall):166 - ----- END CHECK -----
2024-09-04 06:27:24 INFO i.a.c.i.LineGobbler(voidCall):166 - 
2024-09-04 06:27:24 INFO i.a.c.ConnectorWatcher(run):96 - Connector exited with 0
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):189 - Reading messages from protocol version 0.2.0
2024-09-04 06:27:24 WARN i.a.m.l.MetricClientFactory(getMetricClient):43 - MetricClient has not been initialized. Must call MetricClientFactory.CreateMetricClient before using MetricClient. Using a dummy client for now. Ignore this if Airbyte is configured to not publish any metrics.
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.d.m.MongodbDestination(main):63 starting destination: class io.airbyte.integrations.destination.mongodb.MongodbDestination
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {check=null, config=/config/connectionConfiguration.json}
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.b.IntegrationRunner(runInternal):106 Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.b.IntegrationRunner(runInternal):107 Command: CHECK
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.b.IntegrationRunner(runInternal):108 Integration config: IntegrationConfig{command=CHECK, configPath='/config/connectionConfiguration.json', catalogPath='null', statePath='null'}
2024-09-04 06:27:24 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):305 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-09-04 06:27:24 WARN i.a.w.i.VersionedAirbyteStreamFactory(internalLog):305 - WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 Adding discovered server <redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017 to client view of cluster
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 MongoClient with metadata {"driver": {"name": "mongo-java-driver|sync", "version": "4.10.1"}, "os": {"type": "Linux", "name": "Linux", "architecture": "amd64", "version": "5.15.146+"}, "platform": "Java/Amazon.com Inc./17.0.4.1+9-LTS", "application": {"name": "Geev-Prod-Airbyte/geev-airbyte?retryWrites=true"}} created with settings MongoClientSettings{readPreference=primary, writeConcern=WriteConcern{w=majority, wTimeout=null ms, journal=null}, retryWrites=true, retryReads=true, readConcern=ReadConcern{level=null}, credential=MongoCredential{mechanism=null, userName='airbyte', source='admin', password=<hidden>, mechanismProperties=<hidden>}, streamFactoryFactory=null, commandListeners=[], codecRegistry=ProvidersCodecRegistry{codecProviders=[ValueCodecProvider{}, BsonValueCodecProvider{}, DBRefCodecProvider{}, DBObjectCodecProvider{}, DocumentCodecProvider{}, CollectionCodecProvider{}, IterableCodecProvider{}, MapCodecProvider{}, GeoJsonCodecProvider{}, GridFSFileCodecProvider{}, Jsr310CodecProvider{}, JsonObjectCodecProvider{}, BsonCodecProvider{}, EnumCodecProvider{}, com.mongodb.client.model.mql.ExpressionCodecProvider@1c025cb, com.mongodb.Jep395RecordCodecProvider@50825a02, com.mongodb.KotlinCodecProvider@68809cc7]}, loggerSettings=LoggerSettings{maxDocumentLength=1000}, clusterSettings={hosts=[127.0.0.1:27017], srvHost=<redacted>.<redacted>.gcp.mongodb.net, srvServiceName=mongodb, mode=MULTIPLE, requiredClusterType=REPLICA_SET, requiredReplicaSetName='atlas-dr4cmd-shard-0', serverSelector='null', clusterListeners='[]', serverSelectionTimeout='30000 ms', localThreshold='30000 ms'}, socketSettings=SocketSettings{connectTimeoutMS=10000, readTimeoutMS=0, receiveBufferSize=0, sendBufferSize=0}, heartbeatSocketSettings=SocketSettings{connectTimeoutMS=10000, readTimeoutMS=10000, receiveBufferSize=0, sendBufferSize=0}, connectionPoolSettings=ConnectionPoolSettings{maxSize=100, minSize=0, maxWaitTimeMS=120000, maxConnectionLifeTimeMS=0, maxConnectionIdleTimeMS=0, maintenanceInitialDelayMS=0, maintenanceFrequencyMS=60000, connectionPoolListeners=[], maxConnecting=2}, serverSettings=ServerSettings{heartbeatFrequencyMS=10000, minHeartbeatFrequencyMS=500, serverListeners='[]', serverMonitorListeners='[]'}, sslSettings=SslSettings{enabled=true, invalidHostNameAllowed=false, context=null}, applicationName='Geev-Prod-Airbyte/geev-airbyte?retryWrites=true', compressorList=[], uuidRepresentation=UNSPECIFIED, serverApi=null, autoEncryptionSettings=null, dnsClient=null, inetAddressResolver=null, contextProvider=null}
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 Adding discovered server <redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017 to client view of cluster
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 Adding discovered server <redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017 to client view of cluster
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 Cluster description not yet available. Waiting for 30000 ms before timing out
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 No server chosen by ReadPreferenceServerSelector{readPreference=primary} from cluster description ClusterDescription{type=REPLICA_SET, connectionMode=MULTIPLE, serverDescriptions=[ServerDescription{address=<redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017, type=UNKNOWN, state=CONNECTING}, ServerDescription{address=<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, type=UNKNOWN, state=CONNECTING}, ServerDescription{address=<redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 Monitor thread successfully connected to server with description ServerDescription{address=<redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=21, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=219223837, setName='atlas-dr4cmd-shard-0', canonicalAddress=<redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017, hosts=[<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017], passives=[], arbiters=[], primary='<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='europe-west1-b'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='GCP'}, Tag{name='region', value='WESTERN_EUROPE'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=null, setVersion=18, topologyVersion=TopologyVersion{processId=66d5f17ceb0ef254d7e6c362, counter=5}, lastWriteDate=Wed Sep 04 06:27:21 UTC 2024, lastUpdateTimeNanos=48799003513997}
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 Monitor thread successfully connected to server with description ServerDescription{address=<redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=21, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=226827940, setName='atlas-dr4cmd-shard-0', canonicalAddress=<redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, hosts=[<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017], passives=[], arbiters=[], primary='<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='europe-west1-c'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='GCP'}, Tag{name='region', value='WESTERN_EUROPE'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=null, setVersion=18, topologyVersion=TopologyVersion{processId=66d5f26a59c0c53ab1452f61, counter=5}, lastWriteDate=Wed Sep 04 06:27:21 UTC 2024, lastUpdateTimeNanos=48799010585442}
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 Monitor thread successfully connected to server with description ServerDescription{address=<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=21, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=223553650, setName='atlas-dr4cmd-shard-0', canonicalAddress=<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, hosts=[<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017], passives=[], arbiters=[], primary='<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='europe-west1-d'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='GCP'}, Tag{name='region', value='WESTERN_EUROPE'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=7fffffff0000000000000133, setVersion=18, topologyVersion=TopologyVersion{processId=66d5f088656af58c2c68201f, counter=9}, lastWriteDate=Wed Sep 04 06:27:21 UTC 2024, lastUpdateTimeNanos=48799007315790}
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO c.m.i.d.l.SLF4JLogger(info):71 Discovered replica set primary <redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017 with max election id 7fffffff0000000000000133 and max set version 18
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.b.IntegrationRunner(runInternal):197 Completed integration: io.airbyte.integrations.base.ssh.SshWrappedDestination
2024-09-04 06:27:24 INFO i.a.w.i.VersionedAirbyteStreamFactory(internalLog):308 - INFO i.a.i.d.m.MongodbDestination(main):65 completed destination: class io.airbyte.integrations.destination.mongodb.MongodbDestination
2024-09-04 06:27:24 INFO i.a.c.ConnectorMessageProcessor(updateConfigFromControlMessage):231 - Checking for optional control message...
2024-09-04 06:27:24 INFO i.a.c.ConnectorWatcher(run):134 - Writing output of 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check to the doc store
2024-09-04 06:27:24 INFO i.a.c.ConnectorWatcher(run):136 - Marking workload as successful
2024-09-04 06:27:24 INFO i.a.c.ConnectorWatcher(exitProperly):189 - Deliberately exiting process with code 0.
2024-09-04 06:27:24 INFO i.a.c.i.LineGobbler(voidCall):166 - 
2024-09-04 06:27:24 INFO i.a.c.i.LineGobbler(voidCall):166 - ----- END CHECK -----
2024-09-04 06:27:24 INFO i.a.c.i.LineGobbler(voidCall):166 - 
2024-09-04 06:27:25 platform > Using job log path: /workspace/9301/4/logs.log
2024-09-04 06:27:25 platform > Executing worker wrapper. Airbyte version: 0.64.1
2024-09-04 06:27:25 platform > Creating workload ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync
2024-09-04 06:27:25 platform > Workload ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync is pending
2024-09-04 06:27:34 INFO i.m.r.Micronaut(start):101 - Startup completed in 4230ms. Server Running: http://orchestrator-repl-job-9301-attempt-4:9000
2024-09-04 06:27:37 replication-orchestrator > Unknown keyword airbyte_type - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword or if it should generate annotations AnnotationKeyword
2024-09-04 06:27:05 INFO i.a.w.l.c.WorkloadApiClient(claim):75 - Claimed: true for bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check via API for local
2024-09-04 06:27:05 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: CHECK_STATUS — (workloadId = bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:05 INFO i.a.w.l.p.s.CheckStatusStage(applyStage):59 - No pod found running for workload bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check
2024-09-04 06:27:05 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: BUILD — (workloadId = bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:05 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: MUTEX — (workloadId = bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:05 INFO i.a.w.l.p.s.EnforceMutexStage(applyStage):50 - No mutex key specified for workload: bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check. Continuing...
2024-09-04 06:27:05 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: LAUNCH — (workloadId = bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:09 INFO i.a.w.l.c.WorkloadApiClient(updateStatusToLaunched):60 - Attempting to update workload: bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check to LAUNCHED.
2024-09-04 06:27:09 INFO i.a.w.l.p.h.SuccessHandler(accept):60 - Pipeline completed for workload: bfd1ddf8-ae8a-4620-b1d7-55597d2ba08c_9301_4_check.
2024-09-04 06:27:15 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: CLAIM — (workloadId = 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:15 INFO i.a.w.l.c.WorkloadApiClient(claim):75 - Claimed: true for 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check via API for local
2024-09-04 06:27:15 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: CHECK_STATUS — (workloadId = 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:15 INFO i.a.w.l.p.s.CheckStatusStage(applyStage):59 - No pod found running for workload 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check
2024-09-04 06:27:15 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: BUILD — (workloadId = 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:15 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: MUTEX — (workloadId = 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:15 INFO i.a.w.l.p.s.EnforceMutexStage(applyStage):50 - No mutex key specified for workload: 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check. Continuing...
2024-09-04 06:27:15 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: LAUNCH — (workloadId = 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check) — (dataplaneId = local)
2024-09-04 06:27:19 INFO i.a.w.l.c.WorkloadApiClient(updateStatusToLaunched):60 - Attempting to update workload: 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check to LAUNCHED.
2024-09-04 06:27:19 INFO i.a.w.l.p.h.SuccessHandler(accept):60 - Pipeline completed for workload: 8b746512-8c2e-6ac1-4adc-b59faafd473c_9301_4_check.
2024-09-04 06:27:25 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: CLAIM — (workloadId = ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync) — (dataplaneId = local)
2024-09-04 06:27:25 INFO i.a.w.l.c.WorkloadApiClient(claim):75 - Claimed: true for ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync via API for local
2024-09-04 06:27:25 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: CHECK_STATUS — (workloadId = ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync) — (dataplaneId = local)
2024-09-04 06:27:25 INFO i.a.w.l.p.s.CheckStatusStage(applyStage):59 - No pod found running for workload ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync
2024-09-04 06:27:25 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: BUILD — (workloadId = ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync) — (dataplaneId = local)
2024-09-04 06:27:25 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: MUTEX — (workloadId = ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync) — (dataplaneId = local)
2024-09-04 06:27:25 INFO i.a.w.l.p.s.EnforceMutexStage(applyStage):54 - Mutex key: ef06557a-92d3-41a9-b7da-843a7e984712 specified for workload: ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync. Attempting to delete existing pods...
2024-09-04 06:27:25 INFO i.a.w.l.p.s.EnforceMutexStage(applyStage):65 - Mutex key: ef06557a-92d3-41a9-b7da-843a7e984712 specified for workload: ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync found no existing pods. Continuing...
2024-09-04 06:27:25 INFO i.a.w.l.p.s.m.Stage(apply):39 - APPLY Stage: LAUNCH — (workloadId = ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync) — (dataplaneId = local)
2024-09-04 06:27:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):342 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2024-09-04 06:27:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):342 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2024-09-04 06:27:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):342 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2024-09-04 06:27:25 INFO i.a.c.EnvConfigs(getEnvOrDefault):342 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2024-09-04 06:27:42 INFO i.a.w.l.c.WorkloadApiClient(updateStatusToLaunched):60 - Attempting to update workload: ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync to LAUNCHED.
2024-09-04 06:27:42 INFO i.a.w.l.p.h.SuccessHandler(accept):60 - Pipeline completed for workload: ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync.
2024-09-04 06:27:35 INFO i.a.f.ConfigFileClient(<init>):113 - path /flags does not exist, will return default flag values
2024-09-04 06:27:35 WARN i.a.m.l.MetricClientFactory(initialize):72 - MetricClient was not recognized or not provided. Accepted values are `datadog` or `otel`. 
2024-09-04 06:27:37 replication-orchestrator > Concurrent stream read enabled? false
2024-09-04 06:27:37 replication-orchestrator > Setting up source...
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_MEMORY_LIMIT: '50Mi'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_MEMORY_REQUEST: '25Mi'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_MEMORY_LIMIT: '50Mi'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_MEMORY_REQUEST: '25Mi'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_MEMORY_LIMIT: '50Mi'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_MEMORY_REQUEST: '25Mi'
2024-09-04 06:27:37 replication-orchestrator > Setting up destination...
2024-09-04 06:27:37 replication-orchestrator > Setting up replication worker...
2024-09-04 06:27:37 replication-orchestrator > starting state flush thread for connectionId ef06557a-92d3-41a9-b7da-843a7e984712
2024-09-04 06:27:37 replication-orchestrator > Using ClosableLinkedBlockingQueue
2024-09-04 06:27:37 replication-orchestrator > Using ClosableLinkedBlockingQueue
2024-09-04 06:27:37 replication-orchestrator > Running replication worker...
2024-09-04 06:27:37 replication-orchestrator > start sync worker. job id: 9301 attempt id: 4
2024-09-04 06:27:37 replication-orchestrator > 
2024-09-04 06:27:37 replication-orchestrator > ----- START REPLICATION -----
2024-09-04 06:27:37 replication-orchestrator > 
2024-09-04 06:27:37 replication-orchestrator > Running destination...
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2024-09-04 06:27:37 replication-orchestrator > Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2024-09-04 06:27:37 replication-orchestrator > Attempting to start pod = destination-mongodb-write-9301-4-jorlm for airbyte/destination-mongodb:0.2.0 with resources ConnectorResourceRequirements[main=io.airbyte.config.ResourceRequirements@666e753a[cpuRequest=1,cpuLimit=2,memoryRequest=2Gi,memoryLimit=2Gi,additionalProperties={}], heartbeat=io.airbyte.config.ResourceRequirements@f05393e[cpuRequest=0.05,cpuLimit=0.2,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdErr=io.airbyte.config.ResourceRequirements@5c76416f[cpuRequest=0.01,cpuLimit=0.5,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdIn=io.airbyte.config.ResourceRequirements@5e352f24[cpuRequest=0.5,cpuLimit=2,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdOut=io.airbyte.config.ResourceRequirements@662f4685[cpuRequest=0.01,cpuLimit=0.5,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}]] and allowedHosts null
2024-09-04 06:27:37 replication-orchestrator > Attempting to start pod = source-bigquery-read-9301-4-ihoiv for airbyte/source-bigquery:0.4.2 with resources ConnectorResourceRequirements[main=io.airbyte.config.ResourceRequirements@31b1dd52[cpuRequest=1,cpuLimit=2,memoryRequest=2Gi,memoryLimit=2Gi,additionalProperties={}], heartbeat=io.airbyte.config.ResourceRequirements@f05393e[cpuRequest=0.05,cpuLimit=0.2,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdErr=io.airbyte.config.ResourceRequirements@4794c2a6[cpuRequest=0.01,cpuLimit=0.5,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}], stdIn=null, stdOut=io.airbyte.config.ResourceRequirements@101f3fd[cpuRequest=0.5,cpuLimit=1,memoryRequest=25Mi,memoryLimit=50Mi,additionalProperties={}]] and allowedHosts null
2024-09-04 06:27:37 replication-orchestrator > destination-mongodb-write-9301-4-jorlm stdoutLocalPort = 9877
2024-09-04 06:27:37 replication-orchestrator > source-bigquery-read-9301-4-ihoiv stdoutLocalPort = 9878
2024-09-04 06:27:37 replication-orchestrator > destination-mongodb-write-9301-4-jorlm stderrLocalPort = 9879
2024-09-04 06:27:37 replication-orchestrator > source-bigquery-read-9301-4-ihoiv stderrLocalPort = 9880
2024-09-04 06:27:37 replication-orchestrator > Creating stdout socket server...
2024-09-04 06:27:37 replication-orchestrator > Creating stderr socket server...
2024-09-04 06:27:37 replication-orchestrator > Creating stdout socket server...
2024-09-04 06:27:37 replication-orchestrator > Creating stderr socket server...
2024-09-04 06:27:37 replication-orchestrator > Creating pod destination-mongodb-write-9301-4-jorlm...
2024-09-04 06:27:37 replication-orchestrator > Creating pod source-bigquery-read-9301-4-ihoiv...
2024-09-04 06:27:38 replication-orchestrator > Waiting for init container to be ready before copying files...
2024-09-04 06:27:38 replication-orchestrator > Waiting for init container to be ready before copying files...
2024-09-04 06:27:39 replication-orchestrator > Init container ready..
2024-09-04 06:27:39 replication-orchestrator > Copying files...
2024-09-04 06:27:39 replication-orchestrator > Uploading file: destination_config.json
2024-09-04 06:27:39 replication-orchestrator > kubectl cp /tmp/b1634b96-b217-459f-b7f2-9d321f471054/destination_config.json data-platform/destination-mongodb-write-9301-4-jorlm:/config/destination_config.json -c init --retries=3
2024-09-04 06:27:39 replication-orchestrator > Waiting for kubectl cp to complete
2024-09-04 06:27:39 replication-orchestrator > Init container ready..
2024-09-04 06:27:39 replication-orchestrator > Copying files...
2024-09-04 06:27:39 replication-orchestrator > Uploading file: source_config.json
2024-09-04 06:27:39 replication-orchestrator > kubectl cp /tmp/0ef0083f-4936-45a0-9c1e-f4e913c6c689/source_config.json data-platform/source-bigquery-read-9301-4-ihoiv:/config/source_config.json -c init --retries=3
2024-09-04 06:27:39 replication-orchestrator > Waiting for kubectl cp to complete
2024-09-04 06:27:39 replication-orchestrator > kubectl cp complete, closing process
2024-09-04 06:27:39 replication-orchestrator > Uploading file: destination_catalog.json
2024-09-04 06:27:39 replication-orchestrator > kubectl cp /tmp/96ec0f68-4410-45a5-adca-11095ac1caad/destination_catalog.json data-platform/destination-mongodb-write-9301-4-jorlm:/config/destination_catalog.json -c init --retries=3
2024-09-04 06:27:39 replication-orchestrator > Waiting for kubectl cp to complete
2024-09-04 06:27:40 replication-orchestrator > kubectl cp complete, closing process
2024-09-04 06:27:40 replication-orchestrator > Uploading file: source_catalog.json
2024-09-04 06:27:40 replication-orchestrator > kubectl cp /tmp/801bc3eb-d757-4f6d-89ab-83a617dba067/source_catalog.json data-platform/source-bigquery-read-9301-4-ihoiv:/config/source_catalog.json -c init --retries=3
2024-09-04 06:27:40 replication-orchestrator > Waiting for kubectl cp to complete
2024-09-04 06:27:40 replication-orchestrator > kubectl cp complete, closing process
2024-09-04 06:27:40 replication-orchestrator > Uploading file: FINISHED_UPLOADING
2024-09-04 06:27:40 replication-orchestrator > kubectl cp /tmp/e8ebbbb0-b0ba-4753-8781-f3cdc2eedb56/FINISHED_UPLOADING data-platform/destination-mongodb-write-9301-4-jorlm:/config/FINISHED_UPLOADING -c init --retries=3
2024-09-04 06:27:40 replication-orchestrator > Waiting for kubectl cp to complete
2024-09-04 06:27:40 replication-orchestrator > kubectl cp complete, closing process
2024-09-04 06:27:40 replication-orchestrator > Uploading file: FINISHED_UPLOADING
2024-09-04 06:27:40 replication-orchestrator > kubectl cp /tmp/89e878d4-1b20-42fb-837f-91e4cb2abd94/FINISHED_UPLOADING data-platform/source-bigquery-read-9301-4-ihoiv:/config/FINISHED_UPLOADING -c init --retries=3
2024-09-04 06:27:40 replication-orchestrator > Waiting for kubectl cp to complete
2024-09-04 06:27:40 replication-orchestrator > kubectl cp complete, closing process
2024-09-04 06:27:40 replication-orchestrator > Waiting until pod is ready...
2024-09-04 06:27:40 replication-orchestrator > kubectl cp complete, closing process
2024-09-04 06:27:40 replication-orchestrator > Waiting until pod is ready...
2024-09-04 06:27:40 replication-orchestrator > Setting stdout...
2024-09-04 06:27:41 replication-orchestrator > Setting stderr...
2024-09-04 06:27:41 replication-orchestrator > Reading pod IP...
2024-09-04 06:27:41 replication-orchestrator > Pod IP: 10.48.154.58
2024-09-04 06:27:41 replication-orchestrator > Using null stdin output stream...
2024-09-04 06:27:41 replication-orchestrator > Reading messages from protocol version 0.2.0
2024-09-04 06:27:41 replication-orchestrator > Setting stdout...
2024-09-04 06:27:42 replication-orchestrator > Setting stderr...
2024-09-04 06:27:42 replication-orchestrator > Reading pod IP...
2024-09-04 06:27:42 replication-orchestrator > Pod IP: 10.48.155.86
2024-09-04 06:27:42 replication-orchestrator > Creating stdin socket...
2024-09-04 06:27:42 replication-orchestrator > Writing messages to protocol version 0.2.0
2024-09-04 06:27:42 replication-orchestrator > Reading messages from protocol version 0.2.0
2024-09-04 06:27:42 replication-orchestrator > Starting workload heartbeat
2024-09-04 06:27:42 replication-orchestrator > readFromSource: start
2024-09-04 06:27:42 replication-orchestrator > Starting source heartbeat check. Will check threshold of 10800 seconds, every 1 minutes.
2024-09-04 06:27:42 replication-orchestrator > processMessage: start
2024-09-04 06:27:42 replication-orchestrator > writeToDestination: start
2024-09-04 06:27:42 replication-orchestrator > readFromDestination: start
2024-09-04 06:27:42 source > INFO i.a.i.s.b.BigQuerySource(main):219 starting source: class io.airbyte.integrations.source.bigquery.BigQuerySource
2024-09-04 06:27:42 source > INFO i.a.c.i.b.IntegrationCliParser(parseOptions):126 integration args: {read=null, catalog=source_catalog.json, config=source_config.json}
2024-09-04 06:27:42 source > INFO i.a.c.i.b.IntegrationRunner(runInternal):132 Running integration: io.airbyte.integrations.source.bigquery.BigQuerySource
2024-09-04 06:27:42 source > INFO i.a.c.i.b.IntegrationRunner(runInternal):133 Command: READ
2024-09-04 06:27:42 source > INFO i.a.c.i.b.IntegrationRunner(runInternal):134 Integration config: IntegrationConfig{command=READ, configPath='source_config.json', catalogPath='source_catalog.json', statePath='null'}
2024-09-04 06:27:42 source > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-09-04 06:27:42 source > INFO i.a.c.i.s.r.s.StateManagerFactory(createStateManager):57 Stream state manager selected to manage state object with type STREAM.
2024-09-04 06:27:42 source > INFO i.a.c.i.s.r.s.CursorManager(createCursorInfoForStream):192 No cursor field set in catalog but not present in state. Stream: data_platform_gold_view_agg_users_lvl1_favourite_categories, New Cursor Field: null. Resetting cursor value
2024-09-04 06:27:43 destination > INFO i.a.i.d.m.MongodbDestination(main):63 starting destination: class io.airbyte.integrations.destination.mongodb.MongodbDestination
2024-09-04 06:27:43 destination > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2024-09-04 06:27:43 destination > INFO i.a.i.b.IntegrationRunner(runInternal):106 Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination
2024-09-04 06:27:43 destination > INFO i.a.i.b.IntegrationRunner(runInternal):107 Command: WRITE
2024-09-04 06:27:43 destination > INFO i.a.i.b.IntegrationRunner(runInternal):108 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2024-09-04 06:27:43 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-09-04 06:27:43 destination > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2024-09-04 06:27:43 destination > INFO i.a.i.b.s.SshTunnel(getInstance):204 Starting connection with method: NO_TUNNEL
2024-09-04 06:27:43 destination > INFO c.m.i.d.l.SLF4JLogger(info):71 Adding discovered server <redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017 to client view of cluster
2024-09-04 06:27:43 destination > INFO c.m.i.d.l.SLF4JLogger(info):71 MongoClient with metadata {"driver": {"name": "mongo-java-driver|sync", "version": "4.10.1"}, "os": {"type": "Linux", "name": "Linux", "architecture": "amd64", "version": "5.15.146+"}, "platform": "Java/Amazon.com Inc./17.0.4.1+9-LTS", "application": {"name": "Geev-Prod-Airbyte/geev-airbyte?retryWrites=true"}} created with settings MongoClientSettings{readPreference=primary, writeConcern=WriteConcern{w=majority, wTimeout=null ms, journal=null}, retryWrites=true, retryReads=true, readConcern=ReadConcern{level=null}, credential=MongoCredential{mechanism=null, userName='airbyte', source='admin', password=<hidden>, mechanismProperties=<hidden>}, streamFactoryFactory=null, commandListeners=[], codecRegistry=ProvidersCodecRegistry{codecProviders=[ValueCodecProvider{}, BsonValueCodecProvider{}, DBRefCodecProvider{}, DBObjectCodecProvider{}, DocumentCodecProvider{}, CollectionCodecProvider{}, IterableCodecProvider{}, MapCodecProvider{}, GeoJsonCodecProvider{}, GridFSFileCodecProvider{}, Jsr310CodecProvider{}, JsonObjectCodecProvider{}, BsonCodecProvider{}, EnumCodecProvider{}, com.mongodb.client.model.mql.ExpressionCodecProvider@70325d20, com.mongodb.Jep395RecordCodecProvider@7c2327fa, com.mongodb.KotlinCodecProvider@4d847d32]}, loggerSettings=LoggerSettings{maxDocumentLength=1000}, clusterSettings={hosts=[127.0.0.1:27017], srvHost=<redacted>.<redacted>.gcp.mongodb.net, srvServiceName=mongodb, mode=MULTIPLE, requiredClusterType=REPLICA_SET, requiredReplicaSetName='atlas-dr4cmd-shard-0', serverSelector='null', clusterListeners='[]', serverSelectionTimeout='30000 ms', localThreshold='30000 ms'}, socketSettings=SocketSettings{connectTimeoutMS=10000, readTimeoutMS=0, receiveBufferSize=0, sendBufferSize=0}, heartbeatSocketSettings=SocketSettings{connectTimeoutMS=10000, readTimeoutMS=10000, receiveBufferSize=0, sendBufferSize=0}, connectionPoolSettings=ConnectionPoolSettings{maxSize=100, minSize=0, maxWaitTimeMS=120000, maxConnectionLifeTimeMS=0, maxConnectionIdleTimeMS=0, maintenanceInitialDelayMS=0, maintenanceFrequencyMS=60000, connectionPoolListeners=[], maxConnecting=2}, serverSettings=ServerSettings{heartbeatFrequencyMS=10000, minHeartbeatFrequencyMS=500, serverListeners='[]', serverMonitorListeners='[]'}, sslSettings=SslSettings{enabled=true, invalidHostNameAllowed=false, context=null}, applicationName='Geev-Prod-Airbyte/geev-airbyte?retryWrites=true', compressorList=[], uuidRepresentation=UNSPECIFIED, serverApi=null, autoEncryptionSettings=null, dnsClient=null, inetAddressResolver=null, contextProvider=null}
2024-09-04 06:27:43 destination > INFO c.m.i.d.l.SLF4JLogger(info):71 Adding discovered server <redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017 to client view of cluster
2024-09-04 06:27:43 destination > INFO c.m.i.d.l.SLF4JLogger(info):71 Adding discovered server <redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017 to client view of cluster
2024-09-04 06:27:43 destination > INFO c.m.i.d.l.SLF4JLogger(info):71 No server chosen by WritableServerSelector from cluster description ClusterDescription{type=REPLICA_SET, connectionMode=MULTIPLE, serverDescriptions=[ServerDescription{address=<redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017, type=UNKNOWN, state=CONNECTING}, ServerDescription{address=<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, type=UNKNOWN, state=CONNECTING}, ServerDescription{address=<redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, type=UNKNOWN, state=CONNECTING}]}. Waiting for 30000 ms before timing out
2024-09-04 06:27:44 destination > INFO c.m.i.d.l.SLF4JLogger(info):71 Monitor thread successfully connected to server with description ServerDescription{address=<redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=21, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=549361975, setName='atlas-dr4cmd-shard-0', canonicalAddress=<redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, hosts=[<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017], passives=[], arbiters=[], primary='<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='europe-west1-c'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='GCP'}, Tag{name='region', value='WESTERN_EUROPE'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=null, setVersion=18, topologyVersion=TopologyVersion{processId=66d5f26a59c0c53ab1452f61, counter=5}, lastWriteDate=Wed Sep 04 06:27:44 UTC 2024, lastUpdateTimeNanos=53835122894722}
2024-09-04 06:27:44 destination > INFO c.m.i.d.l.SLF4JLogger(info):71 Monitor thread successfully connected to server with description ServerDescription{address=<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, type=REPLICA_SET_PRIMARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=21, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=549952823, setName='atlas-dr4cmd-shard-0', canonicalAddress=<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, hosts=[<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017], passives=[], arbiters=[], primary='<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='europe-west1-d'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='GCP'}, Tag{name='region', value='WESTERN_EUROPE'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=7fffffff0000000000000133, setVersion=18, topologyVersion=TopologyVersion{processId=66d5f088656af58c2c68201f, counter=9}, lastWriteDate=Wed Sep 04 06:27:44 UTC 2024, lastUpdateTimeNanos=53835122894755}
2024-09-04 06:27:44 destination > INFO c.m.i.d.l.SLF4JLogger(info):71 Monitor thread successfully connected to server with description ServerDescription{address=<redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017, type=REPLICA_SET_SECONDARY, state=CONNECTED, ok=true, minWireVersion=0, maxWireVersion=21, maxDocumentSize=16777216, logicalSessionTimeoutMinutes=30, roundTripTimeNanos=549314477, setName='atlas-dr4cmd-shard-0', canonicalAddress=<redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017, hosts=[<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-01.<redacted>.gcp.mongodb.net:27017, <redacted>-shard-00-00.<redacted>.gcp.mongodb.net:27017], passives=[], arbiters=[], primary='<redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017', tagSet=TagSet{[Tag{name='availabilityZone', value='europe-west1-b'}, Tag{name='diskState', value='READY'}, Tag{name='nodeType', value='ELECTABLE'}, Tag{name='provider', value='GCP'}, Tag{name='region', value='WESTERN_EUROPE'}, Tag{name='workloadType', value='OPERATIONAL'}]}, electionId=null, setVersion=18, topologyVersion=TopologyVersion{processId=66d5f17ceb0ef254d7e6c362, counter=5}, lastWriteDate=Wed Sep 04 06:27:44 UTC 2024, lastUpdateTimeNanos=53835122894814}
2024-09-04 06:27:44 destination > INFO c.m.i.d.l.SLF4JLogger(info):71 Discovered replica set primary <redacted>-shard-00-02.<redacted>.gcp.mongodb.net:27017 with max election id 7fffffff0000000000000133 and max set version 18
2024-09-04 06:28:03 source > INFO i.a.i.s.b.BigQuerySource(queryTableFullRefresh):180 Queueing query for table: view_agg_users_lvl1_favourite_categories
2024-09-04 06:28:03 source > INFO i.a.c.i.s.r.RelationalDbQueryUtils(lambda$queryTable$0):73 Queueing query: SELECT `user_id`,`item_parent_category_name`,`score`,`rank`,`favouriteAt` FROM `data_platform_gold`.`view_agg_users_lvl1_favourite_categories`
2024-09-04 06:28:18 replication-orchestrator > Stream status TRACE received of status: STARTED for stream data_platform_gold:view_agg_users_lvl1_favourite_categories
2024-09-04 06:28:18 replication-orchestrator > Sending update for data_platform_gold:view_agg_users_lvl1_favourite_categories - null -> RUNNING
2024-09-04 06:28:18 replication-orchestrator > Stream Status Update Received: data_platform_gold:view_agg_users_lvl1_favourite_categories - RUNNING
2024-09-04 06:28:18 replication-orchestrator > Creating status: data_platform_gold:view_agg_users_lvl1_favourite_categories - RUNNING
2024-09-04 06:28:18 replication-orchestrator > Stream status TRACE received of status: RUNNING for stream data_platform_gold:view_agg_users_lvl1_favourite_categories
2024-09-04 06:28:19 replication-orchestrator > Records read: 5000 (655 KB)
2024-09-04 06:28:27 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 10000
2024-09-04 06:28:27 replication-orchestrator > Records read: 10000 (1 MB)
2024-09-04 06:28:39 replication-orchestrator > Records read: 15000 (1 MB)
2024-09-04 06:28:51 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 20000
2024-09-04 06:28:55 replication-orchestrator > Records read: 20000 (2 MB)
2024-09-04 06:29:05 replication-orchestrator > Records read: 25000 (3 MB)
2024-09-04 06:29:12 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 30000
2024-09-04 06:29:16 replication-orchestrator > Records read: 30000 (3 MB)
2024-09-04 06:29:27 replication-orchestrator > Records read: 35000 (4 MB)
2024-09-04 06:29:38 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 40000
2024-09-04 06:29:38 replication-orchestrator > Records read: 40000 (5 MB)
2024-09-04 06:29:50 replication-orchestrator > Records read: 45000 (5 MB)
2024-09-04 06:30:02 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 50000
2024-09-04 06:30:02 replication-orchestrator > Records read: 50000 (6 MB)
2024-09-04 06:30:15 replication-orchestrator > Records read: 55000 (7 MB)
2024-09-04 06:30:21 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 60000
2024-09-04 06:30:25 replication-orchestrator > Records read: 60000 (7 MB)
2024-09-04 06:30:37 replication-orchestrator > Records read: 65000 (8 MB)
2024-09-04 06:30:44 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 70000
2024-09-04 06:30:48 replication-orchestrator > Records read: 70000 (9 MB)
2024-09-04 06:30:57 replication-orchestrator > Records read: 75000 (9 MB)
2024-09-04 06:31:05 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 80000
2024-09-04 06:31:10 replication-orchestrator > Records read: 80000 (10 MB)
2024-09-04 06:31:21 replication-orchestrator > Records read: 85000 (10 MB)
2024-09-04 06:31:28 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 90000
2024-09-04 06:31:28 replication-orchestrator > Records read: 90000 (11 MB)
2024-09-04 06:31:39 replication-orchestrator > Records read: 95000 (12 MB)
2024-09-04 06:31:48 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 100000
2024-09-04 06:31:48 replication-orchestrator > Records read: 100000 (12 MB)
2024-09-04 06:32:00 replication-orchestrator > Records read: 105000 (13 MB)
2024-09-04 06:32:10 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 110000
2024-09-04 06:32:10 replication-orchestrator > Records read: 110000 (14 MB)
2024-09-04 06:32:20 replication-orchestrator > Records read: 115000 (14 MB)
2024-09-04 06:32:32 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 120000
2024-09-04 06:32:32 replication-orchestrator > Records read: 120000 (15 MB)
2024-09-04 06:32:45 replication-orchestrator > Records read: 125000 (16 MB)
2024-09-04 06:32:57 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 130000
2024-09-04 06:32:57 replication-orchestrator > Records read: 130000 (16 MB)
2024-09-04 06:33:08 replication-orchestrator > Records read: 135000 (17 MB)
2024-09-04 06:33:19 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 140000
2024-09-04 06:33:19 replication-orchestrator > Records read: 140000 (18 MB)
2024-09-04 06:33:31 replication-orchestrator > Records read: 145000 (18 MB)
2024-09-04 06:33:45 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 150000
2024-09-04 06:33:45 replication-orchestrator > Records read: 150000 (19 MB)
2024-09-04 06:33:55 replication-orchestrator > Records read: 155000 (20 MB)
2024-09-04 06:34:07 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 160000
2024-09-04 06:34:07 replication-orchestrator > Records read: 160000 (20 MB)
2024-09-04 06:34:20 replication-orchestrator > Records read: 165000 (21 MB)
2024-09-04 06:34:32 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 170000
2024-09-04 06:34:32 replication-orchestrator > Records read: 170000 (21 MB)
2024-09-04 06:34:46 replication-orchestrator > Records read: 175000 (22 MB)
2024-09-04 06:34:55 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 180000
2024-09-04 06:34:55 replication-orchestrator > Records read: 180000 (23 MB)
2024-09-04 06:35:09 replication-orchestrator > Records read: 185000 (23 MB)
2024-09-04 06:35:17 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 190000
2024-09-04 06:35:17 replication-orchestrator > Records read: 190000 (24 MB)
2024-09-04 06:35:31 replication-orchestrator > Records read: 195000 (25 MB)
2024-09-04 06:35:40 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 200000
2024-09-04 06:35:46 replication-orchestrator > Records read: 200000 (25 MB)
2024-09-04 06:35:54 replication-orchestrator > Records read: 205000 (26 MB)
2024-09-04 06:36:08 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 210000
2024-09-04 06:36:08 replication-orchestrator > Records read: 210000 (27 MB)
2024-09-04 06:36:23 replication-orchestrator > Records read: 215000 (27 MB)
2024-09-04 06:36:29 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 220000
2024-09-04 06:36:29 replication-orchestrator > Records read: 220000 (28 MB)
2024-09-04 06:36:46 replication-orchestrator > Records read: 225000 (29 MB)
2024-09-04 06:36:53 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 230000
2024-09-04 06:36:53 replication-orchestrator > Records read: 230000 (29 MB)
2024-09-04 06:37:06 replication-orchestrator > Records read: 235000 (30 MB)
2024-09-04 06:37:13 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 240000
2024-09-04 06:37:22 replication-orchestrator > Records read: 240000 (31 MB)
2024-09-04 06:37:34 replication-orchestrator > Records read: 245000 (31 MB)
2024-09-04 06:37:42 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 250000
2024-09-04 06:37:42 replication-orchestrator > Records read: 250000 (32 MB)
2024-09-04 06:37:57 replication-orchestrator > Records read: 255000 (32 MB)
2024-09-04 06:38:04 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 260000
2024-09-04 06:38:04 replication-orchestrator > Records read: 260000 (33 MB)
2024-09-04 06:38:17 replication-orchestrator > Records read: 265000 (34 MB)
2024-09-04 06:38:25 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 270000
2024-09-04 06:38:33 replication-orchestrator > Records read: 270000 (34 MB)
2024-09-04 06:38:39 replication-orchestrator > Records read: 275000 (35 MB)
2024-09-04 06:38:54 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 280000
2024-09-04 06:38:54 replication-orchestrator > Records read: 280000 (36 MB)
2024-09-04 06:39:07 replication-orchestrator > Records read: 285000 (36 MB)
2024-09-04 06:39:16 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 290000
2024-09-04 06:39:16 replication-orchestrator > Records read: 290000 (37 MB)
2024-09-04 06:39:29 replication-orchestrator > Records read: 295000 (38 MB)
2024-09-04 06:39:36 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 300000
2024-09-04 06:39:43 replication-orchestrator > Records read: 300000 (38 MB)
2024-09-04 06:39:48 replication-orchestrator > Records read: 305000 (39 MB)
2024-09-04 06:40:04 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 310000
2024-09-04 06:40:04 replication-orchestrator > Records read: 310000 (40 MB)
2024-09-04 06:40:19 replication-orchestrator > Records read: 315000 (40 MB)
2024-09-04 06:40:27 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 320000
2024-09-04 06:40:27 replication-orchestrator > Records read: 320000 (41 MB)
2024-09-04 06:40:39 replication-orchestrator > Records read: 325000 (41 MB)
2024-09-04 06:40:55 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 330000
2024-09-04 06:40:55 replication-orchestrator > Records read: 330000 (42 MB)
2024-09-04 06:41:04 replication-orchestrator > Records read: 335000 (43 MB)
2024-09-04 06:41:17 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 340000
2024-09-04 06:41:17 replication-orchestrator > Records read: 340000 (43 MB)
2024-09-04 06:41:30 replication-orchestrator > Records read: 345000 (44 MB)
2024-09-04 06:41:38 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 350000
2024-09-04 06:41:44 replication-orchestrator > Records read: 350000 (45 MB)
2024-09-04 06:41:52 replication-orchestrator > Records read: 355000 (45 MB)
2024-09-04 06:41:58 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 360000
2024-09-04 06:42:06 replication-orchestrator > Records read: 360000 (46 MB)
2024-09-04 06:42:13 replication-orchestrator > Records read: 365000 (47 MB)
2024-09-04 06:42:27 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 370000
2024-09-04 06:42:27 replication-orchestrator > Records read: 370000 (47 MB)
2024-09-04 06:42:42 replication-orchestrator > Records read: 375000 (48 MB)
2024-09-04 06:42:48 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 380000
2024-09-04 06:42:48 replication-orchestrator > Records read: 380000 (49 MB)
2024-09-04 06:43:03 replication-orchestrator > Records read: 385000 (49 MB)
2024-09-04 06:43:09 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 390000
2024-09-04 06:43:16 replication-orchestrator > Records read: 390000 (50 MB)
2024-09-04 06:43:30 replication-orchestrator > Records read: 395000 (51 MB)
2024-09-04 06:43:36 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 400000
2024-09-04 06:43:36 replication-orchestrator > Records read: 400000 (51 MB)
2024-09-04 06:43:51 replication-orchestrator > Records read: 405000 (52 MB)
2024-09-04 06:43:59 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 410000
2024-09-04 06:43:59 replication-orchestrator > Records read: 410000 (52 MB)
2024-09-04 06:44:13 replication-orchestrator > Records read: 415000 (53 MB)
2024-09-04 06:44:20 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 420000
2024-09-04 06:44:28 replication-orchestrator > Records read: 420000 (54 MB)
2024-09-04 06:44:35 replication-orchestrator > Records read: 425000 (54 MB)
2024-09-04 06:44:49 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 430000
2024-09-04 06:44:49 replication-orchestrator > Records read: 430000 (55 MB)
2024-09-04 06:45:03 replication-orchestrator > Records read: 435000 (56 MB)
2024-09-04 06:45:12 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 440000
2024-09-04 06:45:12 replication-orchestrator > Records read: 440000 (56 MB)
2024-09-04 06:45:25 replication-orchestrator > Records read: 445000 (57 MB)
2024-09-04 06:45:33 replication-orchestrator > Records read: 450000 (58 MB)
2024-09-04 06:45:33 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 450000
2024-09-04 06:45:48 replication-orchestrator > Records read: 455000 (58 MB)
2024-09-04 06:45:55 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 460000
2024-09-04 06:46:03 replication-orchestrator > Records read: 460000 (59 MB)
2024-09-04 06:46:09 replication-orchestrator > Records read: 465000 (60 MB)
2024-09-04 06:46:25 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 470000
2024-09-04 06:46:25 replication-orchestrator > Records read: 470000 (60 MB)
2024-09-04 06:46:38 replication-orchestrator > Records read: 475000 (61 MB)
2024-09-04 06:46:46 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 480000
2024-09-04 06:46:46 replication-orchestrator > Records read: 480000 (61 MB)
2024-09-04 06:47:01 replication-orchestrator > Records read: 485000 (62 MB)
2024-09-04 06:47:08 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 490000
2024-09-04 06:47:15 replication-orchestrator > Records read: 490000 (63 MB)
2024-09-04 06:47:24 replication-orchestrator > Records read: 495000 (63 MB)
2024-09-04 06:47:37 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 500000
2024-09-04 06:47:37 replication-orchestrator > Records read: 500000 (64 MB)
2024-09-04 06:47:52 replication-orchestrator > Records read: 505000 (65 MB)
2024-09-04 06:47:58 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 510000
2024-09-04 06:47:58 replication-orchestrator > Records read: 510000 (65 MB)
2024-09-04 06:48:11 replication-orchestrator > Records read: 515000 (66 MB)
2024-09-04 06:48:16 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 520000
2024-09-04 06:48:16 replication-orchestrator > Records read: 520000 (67 MB)
2024-09-04 06:48:29 replication-orchestrator > Records read: 525000 (67 MB)
2024-09-04 06:48:38 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 530000
2024-09-04 06:48:46 replication-orchestrator > Records read: 530000 (68 MB)
2024-09-04 06:48:51 replication-orchestrator > Records read: 535000 (69 MB)
2024-09-04 06:49:06 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 540000
2024-09-04 06:49:06 replication-orchestrator > Records read: 540000 (69 MB)
2024-09-04 06:49:21 replication-orchestrator > Records read: 545000 (70 MB)
2024-09-04 06:49:28 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 550000
2024-09-04 06:49:28 replication-orchestrator > Records read: 550000 (71 MB)
2024-09-04 06:49:36 replication-orchestrator > Records read: 555000 (71 MB)
2024-09-04 06:49:51 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 560000
2024-09-04 06:49:51 replication-orchestrator > Records read: 560000 (72 MB)
2024-09-04 06:50:03 replication-orchestrator > Records read: 565000 (72 MB)
2024-09-04 06:50:10 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 570000
2024-09-04 06:50:10 replication-orchestrator > Records read: 570000 (73 MB)
2024-09-04 06:50:26 replication-orchestrator > Records read: 575000 (74 MB)
2024-09-04 06:50:40 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 580000
2024-09-04 06:50:40 replication-orchestrator > Records read: 580000 (74 MB)
2024-09-04 06:50:54 replication-orchestrator > Records read: 585000 (75 MB)
2024-09-04 06:51:01 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 590000
2024-09-04 06:51:01 replication-orchestrator > Records read: 590000 (76 MB)
2024-09-04 06:51:15 replication-orchestrator > Records read: 595000 (76 MB)
2024-09-04 06:51:23 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 600000
2024-09-04 06:51:30 replication-orchestrator > Records read: 600000 (77 MB)
2024-09-04 06:51:37 replication-orchestrator > Records read: 605000 (78 MB)
2024-09-04 06:51:52 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 610000
2024-09-04 06:51:52 replication-orchestrator > Records read: 610000 (78 MB)
2024-09-04 06:52:06 replication-orchestrator > Records read: 615000 (79 MB)
2024-09-04 06:52:15 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 620000
2024-09-04 06:52:20 replication-orchestrator > Records read: 620000 (80 MB)
2024-09-04 06:52:29 replication-orchestrator > Records read: 625000 (80 MB)
2024-09-04 06:52:44 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 630000
2024-09-04 06:52:44 replication-orchestrator > Records read: 630000 (81 MB)
2024-09-04 06:52:59 replication-orchestrator > Records read: 635000 (81 MB)
2024-09-04 06:53:05 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 640000
2024-09-04 06:53:05 replication-orchestrator > Records read: 640000 (82 MB)
2024-09-04 06:53:20 replication-orchestrator > Records read: 645000 (83 MB)
2024-09-04 06:53:28 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 650000
2024-09-04 06:53:34 replication-orchestrator > Records read: 650000 (83 MB)
2024-09-04 06:53:42 replication-orchestrator > Records read: 655000 (84 MB)
2024-09-04 06:53:55 replication-orchestrator > Records read: 660000 (85 MB)
2024-09-04 06:53:55 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 660000
2024-09-04 06:54:10 replication-orchestrator > Records read: 665000 (85 MB)
2024-09-04 06:54:16 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 670000
2024-09-04 06:54:24 replication-orchestrator > Records read: 670000 (86 MB)
2024-09-04 06:54:30 replication-orchestrator > Records read: 675000 (87 MB)
2024-09-04 06:54:46 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 680000
2024-09-04 06:54:46 replication-orchestrator > Records read: 680000 (87 MB)
2024-09-04 06:54:59 replication-orchestrator > Records read: 685000 (88 MB)
2024-09-04 06:55:06 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 690000
2024-09-04 06:55:13 replication-orchestrator > Records read: 690000 (89 MB)
2024-09-04 06:55:21 replication-orchestrator > Records read: 695000 (89 MB)
2024-09-04 06:55:35 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 700000
2024-09-04 06:55:35 replication-orchestrator > Records read: 700000 (90 MB)
2024-09-04 06:55:47 replication-orchestrator > Records read: 705000 (91 MB)
2024-09-04 06:55:54 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 710000
2024-09-04 06:55:54 replication-orchestrator > Records read: 710000 (91 MB)
2024-09-04 06:56:09 replication-orchestrator > Records read: 715000 (92 MB)
2024-09-04 06:56:24 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 720000
2024-09-04 06:56:24 replication-orchestrator > Records read: 720000 (93 MB)
2024-09-04 06:56:32 replication-orchestrator > Records read: 725000 (93 MB)
2024-09-04 06:56:46 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 730000
2024-09-04 06:56:46 replication-orchestrator > Records read: 730000 (94 MB)
2024-09-04 06:56:59 replication-orchestrator > Records read: 735000 (94 MB)
2024-09-04 06:57:06 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 740000
2024-09-04 06:57:13 replication-orchestrator > Records read: 740000 (95 MB)
2024-09-04 06:57:21 replication-orchestrator > Records read: 745000 (96 MB)
2024-09-04 06:57:34 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 750000
2024-09-04 06:57:34 replication-orchestrator > Records read: 750000 (96 MB)
2024-09-04 06:57:48 replication-orchestrator > Records read: 755000 (97 MB)
2024-09-04 06:57:54 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 760000
2024-09-04 06:58:01 replication-orchestrator > Records read: 760000 (98 MB)
2024-09-04 06:58:16 replication-orchestrator > Records read: 765000 (98 MB)
2024-09-04 06:58:23 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 770000
2024-09-04 06:58:23 replication-orchestrator > Records read: 770000 (99 MB)
2024-09-04 06:58:37 replication-orchestrator > Records read: 775000 (100 MB)
2024-09-04 06:58:44 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 780000
2024-09-04 06:58:52 replication-orchestrator > Records read: 780000 (100 MB)
2024-09-04 06:58:59 replication-orchestrator > Records read: 785000 (101 MB)
2024-09-04 06:59:13 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 790000
2024-09-04 06:59:13 replication-orchestrator > Records read: 790000 (102 MB)
2024-09-04 06:59:27 replication-orchestrator > Records read: 795000 (102 MB)
2024-09-04 06:59:34 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 800000
2024-09-04 06:59:43 replication-orchestrator > Records read: 800000 (103 MB)
2024-09-04 06:59:49 replication-orchestrator > Records read: 805000 (104 MB)
2024-09-04 07:00:04 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 810000
2024-09-04 07:00:04 replication-orchestrator > Records read: 810000 (104 MB)
2024-09-04 07:00:19 replication-orchestrator > Records read: 815000 (105 MB)
2024-09-04 07:00:26 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 820000
2024-09-04 07:00:26 replication-orchestrator > Records read: 820000 (105 MB)
2024-09-04 07:00:41 replication-orchestrator > Records read: 825000 (106 MB)
2024-09-04 07:00:55 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 830000
2024-09-04 07:00:55 replication-orchestrator > Records read: 830000 (107 MB)
2024-09-04 07:01:09 replication-orchestrator > Records read: 835000 (107 MB)
2024-09-04 07:01:16 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 840000
2024-09-04 07:01:16 replication-orchestrator > Records read: 840000 (108 MB)
2024-09-04 07:01:32 replication-orchestrator > Records read: 845000 (109 MB)
2024-09-04 07:01:39 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 850000
2024-09-04 07:01:47 replication-orchestrator > Records read: 850000 (109 MB)
2024-09-04 07:01:55 replication-orchestrator > Records read: 855000 (110 MB)
2024-09-04 07:02:10 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 860000
2024-09-04 07:02:10 replication-orchestrator > Records read: 860000 (111 MB)
2024-09-04 07:02:24 replication-orchestrator > Records read: 865000 (111 MB)
2024-09-04 07:02:32 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 870000
2024-09-04 07:02:38 replication-orchestrator > Records read: 870000 (112 MB)
2024-09-04 07:02:45 replication-orchestrator > Records read: 875000 (113 MB)
2024-09-04 07:03:00 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 880000
2024-09-04 07:03:00 replication-orchestrator > Records read: 880000 (113 MB)
2024-09-04 07:03:13 replication-orchestrator > Records read: 885000 (114 MB)
2024-09-04 07:03:21 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 890000
2024-09-04 07:03:29 replication-orchestrator > Records read: 890000 (115 MB)
2024-09-04 07:03:36 replication-orchestrator > Records read: 895000 (115 MB)
2024-09-04 07:03:51 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 900000
2024-09-04 07:03:51 replication-orchestrator > Records read: 900000 (116 MB)
2024-09-04 07:04:04 replication-orchestrator > Records read: 905000 (117 MB)
2024-09-04 07:04:13 replication-orchestrator > Records read: 910000 (117 MB)
2024-09-04 07:04:13 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 910000
2024-09-04 07:04:27 replication-orchestrator > Records read: 915000 (118 MB)
2024-09-04 07:04:40 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 920000
2024-09-04 07:04:40 replication-orchestrator > Records read: 920000 (118 MB)
2024-09-04 07:04:54 replication-orchestrator > Records read: 925000 (119 MB)
2024-09-04 07:05:02 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 930000
2024-09-04 07:05:08 replication-orchestrator > Records read: 930000 (120 MB)
2024-09-04 07:05:15 replication-orchestrator > Records read: 935000 (120 MB)
2024-09-04 07:05:29 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 940000
2024-09-04 07:05:29 replication-orchestrator > Records read: 940000 (121 MB)
2024-09-04 07:05:44 replication-orchestrator > Records read: 945000 (122 MB)
2024-09-04 07:05:52 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 950000
2024-09-04 07:05:59 replication-orchestrator > Records read: 950000 (122 MB)
2024-09-04 07:06:07 replication-orchestrator > Records read: 955000 (123 MB)
2024-09-04 07:06:22 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 960000
2024-09-04 07:06:22 replication-orchestrator > Records read: 960000 (124 MB)
2024-09-04 07:06:38 replication-orchestrator > Records read: 965000 (124 MB)
2024-09-04 07:06:45 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 970000
2024-09-04 07:06:45 replication-orchestrator > Records read: 970000 (125 MB)
2024-09-04 07:06:59 replication-orchestrator > Records read: 975000 (126 MB)
2024-09-04 07:07:12 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 980000
2024-09-04 07:07:12 replication-orchestrator > Records read: 980000 (126 MB)
2024-09-04 07:07:28 replication-orchestrator > Records read: 985000 (127 MB)
2024-09-04 07:07:35 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 990000
2024-09-04 07:07:35 replication-orchestrator > Records read: 990000 (128 MB)
2024-09-04 07:07:49 replication-orchestrator > Records read: 995000 (128 MB)
2024-09-04 07:07:56 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 1000000
2024-09-04 07:08:03 replication-orchestrator > Records read: 1000000 (129 MB)
2024-09-04 07:08:11 replication-orchestrator > Records read: 1005000 (130 MB)
2024-09-04 07:08:25 replication-orchestrator > Records read: 1010000 (130 MB)
2024-09-04 07:08:25 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 1010000
2024-09-04 07:08:41 replication-orchestrator > Records read: 1015000 (131 MB)
2024-09-04 07:08:49 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 1020000
2024-09-04 07:08:56 replication-orchestrator > Records read: 1020000 (131 MB)
2024-09-04 07:09:03 replication-orchestrator > Records read: 1025000 (132 MB)
2024-09-04 07:09:18 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$createReadIterator$5):432 Reading stream view_agg_users_lvl1_favourite_categories. Records read: 1030000
2024-09-04 07:09:18 replication-orchestrator > Records read: 1030000 (133 MB)
2024-09-04 07:09:18 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$read$1):184 Closing database connection pool.
2024-09-04 07:09:18 source > INFO i.a.c.i.s.r.AbstractDbSource(lambda$read$1):186 Closed database connection pool.
2024-09-04 07:09:18 source > INFO i.a.c.i.b.IntegrationRunner(runInternal):231 Completed integration: io.airbyte.integrations.source.bigquery.BigQuerySource
2024-09-04 07:09:18 source > INFO i.a.i.s.b.BigQuerySource(main):221 completed source: class io.airbyte.integrations.source.bigquery.BigQuerySource
2024-09-04 07:09:18 replication-orchestrator > (pod: data-platform / source-bigquery-read-9301-4-ihoiv) - Closed all resources for pod
2024-09-04 07:09:18 replication-orchestrator > Total records read: 1031449 (133 MB)
2024-09-04 07:09:18 replication-orchestrator > Schema validation was performed to a max of 10 records with errors per stream.
2024-09-04 07:09:18 replication-orchestrator > readFromSource: done. (source.isFinished:true, fromSource.isClosed:false)
2024-09-04 07:09:18 replication-orchestrator > thread status... heartbeat thread: false , replication thread: true
2024-09-04 07:09:25 replication-orchestrator > Stream status TRACE received of status: COMPLETE for stream data_platform_gold:view_agg_users_lvl1_favourite_categories
2024-09-04 07:09:25 replication-orchestrator > processMessage: done. (fromSource.isDone:true, forDest.isClosed:false)
2024-09-04 07:09:25 replication-orchestrator > writeToDestination: done. (forDest.isDone:true, isDestRunning:true)
2024-09-04 07:09:25 replication-orchestrator > thread status... timeout thread: false , replication thread: true
2024-09-04 07:10:36 destination > INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 Airbyte message consumer: succeeded.
2024-09-04 07:10:36 destination > INFO i.a.i.d.m.MongodbRecordConsumer(close):90 Migration finished with no explicit errors. Copying data from tmp tables to permanent
2024-09-04 07:10:56 INFO i.a.a.SegmentAnalyticsClient(close):233 - Closing Segment analytics client...
2024-09-04 07:10:56 INFO i.a.a.BlockingShutdownAnalyticsPlugin(waitForFlush):289 - Waiting for Segment analytic client to flush enqueued messages...
2024-09-04 07:10:56 INFO i.a.a.BlockingShutdownAnalyticsPlugin(waitForFlush):301 - Segment analytic client flush complete.
2024-09-04 07:10:56 INFO i.a.a.SegmentAnalyticsClient(close):237 - Segment analytics client closed.  No new events will be accepted.
2024-09-04 07:10:55 destination > Terminating due to java.lang.OutOfMemoryError: Java heap space
2024-09-04 07:10:56 replication-orchestrator > (pod: data-platform / destination-mongodb-write-9301-4-jorlm) - Closed all resources for pod
2024-09-04 07:10:56 replication-orchestrator > readFromDestination: exception caught
io.airbyte.workers.internal.exception.DestinationException: Destination process exited with non-zero exit code 3
    at io.airbyte.workers.general.BufferedReplicationWorker.readFromDestination(BufferedReplicationWorker.java:490) ~[io.airbyte-airbyte-commons-worker-0.64.1.jar:?]
    at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:219) ~[io.airbyte-airbyte-commons-worker-0.64.1.jar:?]
    at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804) ~[?:?]
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144) ~[?:?]
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642) ~[?:?]
    at java.base/java.lang.Thread.run(Thread.java:1583) [?:?]
2024-09-04 07:10:56 replication-orchestrator > readFromDestination: done. (writeToDestFailed:false, dest.isFinished:true)
2024-09-04 07:10:56 replication-orchestrator > Closing StateCheckSumCountEventHandler
2024-09-04 07:10:56 replication-orchestrator > sync summary: {
  "status" : "failed",
  "recordsSynced" : 0,
  "bytesSynced" : 0,
  "startTime" : 1725431257204,
  "endTime" : 1725433856096,
  "totalStats" : {
    "bytesCommitted" : 0,
    "bytesEmitted" : 139985069,
    "destinationStateMessagesEmitted" : 0,
    "destinationWriteEndTime" : 0,
    "destinationWriteStartTime" : 1725431257247,
    "meanSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBeforeSourceStateMessageEmitted" : 0,
    "maxSecondsBetweenStateMessageEmittedandCommitted" : 0,
    "meanSecondsBetweenStateMessageEmittedandCommitted" : 0,
    "recordsEmitted" : 1031871,
    "recordsCommitted" : 0,
    "replicationEndTime" : 1725433856089,
    "replicationStartTime" : 1725431257204,
    "sourceReadEndTime" : 1725433758099,
    "sourceReadStartTime" : 1725431257248,
    "sourceStateMessagesEmitted" : 0
  },
  "streamStats" : [ {
    "streamName" : "view_agg_users_lvl1_favourite_categories",
    "streamNamespace" : "data_platform_gold",
    "stats" : {
      "bytesCommitted" : 0,
      "bytesEmitted" : 139985069,
      "recordsEmitted" : 1031871,
      "recordsCommitted" : 0
    }
  } ],
  "performanceMetrics" : {
    "processFromSource" : {
      "elapsedTimeInNanos" : 5981281394,
      "executionCount" : 1031874,
      "avgExecTimeInNanos" : 5796.523019283362
    },
    "readFromSource" : {
      "elapsedTimeInNanos" : 44060284532,
      "executionCount" : 1031875,
      "avgExecTimeInNanos" : 42699.24606371896
    },
    "processFromDest" : {
      "elapsedTimeInNanos" : 0,
      "executionCount" : 0,
      "avgExecTimeInNanos" : "NaN"
    },
    "writeToDest" : {
      "elapsedTimeInNanos" : 2465821495924,
      "executionCount" : 1031871,
      "avgExecTimeInNanos" : 2389660.622232818
    },
    "readFromDest" : {
      "elapsedTimeInNanos" : 2593414236319,
      "executionCount" : 218055,
      "avgExecTimeInNanos" : 1.1893394952278094E7
    }
  }
}
2024-09-04 07:10:56 replication-orchestrator > failures: [ {
  "failureOrigin" : "destination",
  "internalMessage" : "Destination process exited with non-zero exit code 3",
  "externalMessage" : "Something went wrong within the destination connector",
  "metadata" : {
    "attemptNumber" : 4,
    "jobId" : 9301,
    "connector_command" : "write"
  },
  "stacktrace" : "io.airbyte.workers.internal.exception.DestinationException: Destination process exited with non-zero exit code 3\n\tat io.airbyte.workers.general.BufferedReplicationWorker.readFromDestination(BufferedReplicationWorker.java:490)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:219)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1583)\n",
  "timestamp" : 1725433856053
}, {
  "failureOrigin" : "replication",
  "internalMessage" : "io.airbyte.workers.exception.WorkerException: Destination process exit with code 3. This warning is normal if the job was cancelled.",
  "externalMessage" : "Something went wrong during replication",
  "metadata" : {
    "attemptNumber" : 4,
    "jobId" : 9301
  },
  "stacktrace" : "java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Destination process exit with code 3. This warning is normal if the job was cancelled.\n\tat io.airbyte.workers.general.BufferedReplicationWorker$CloseableWithTimeout.lambda$close$0(BufferedReplicationWorker.java:535)\n\tat io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithTimeout$5(BufferedReplicationWorker.java:247)\n\tat java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)\n\tat java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)\n\tat java.base/java.lang.Thread.run(Thread.java:1583)\nCaused by: io.airbyte.workers.exception.WorkerException: Destination process exit with code 3. This warning is normal if the job was cancelled.\n\tat io.airbyte.workers.internal.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:186)\n\tat io.airbyte.workers.general.BufferedReplicationWorker$CloseableWithTimeout.lambda$close$0(BufferedReplicationWorker.java:533)\n\t... 5 more\n",
  "timestamp" : 1725433856056
} ]
2024-09-04 07:10:56 replication-orchestrator > 
2024-09-04 07:10:56 replication-orchestrator > ----- END REPLICATION -----
2024-09-04 07:10:56 replication-orchestrator > 
2024-09-04 07:10:56 replication-orchestrator > Returning output...
2024-09-04 07:11:25 platform > Workload ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync has returned a terminal status of failure.  Fetching output...
2024-09-04 07:11:25 platform > Replication output for workload ef06557a-92d3-41a9-b7da-843a7e984712_9301_4_sync : io.airbyte.config.ReplicationOutput@387055b[replicationAttemptSummary=io.airbyte.config.ReplicationAttemptSummary@79db9266[status=failed,recordsSynced=0,bytesSynced=0,startTime=1725431257204,endTime=1725433856096,totalStats=io.airbyte.config.SyncStats@541b109[bytesCommitted=0,bytesEmitted=139985069,destinationStateMessagesEmitted=0,destinationWriteEndTime=0,destinationWriteStartTime=1725431257247,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBeforeSourceStateMessageEmitted=0,maxSecondsBetweenStateMessageEmittedandCommitted=0,meanSecondsBetweenStateMessageEmittedandCommitted=0,recordsEmitted=1031871,recordsCommitted=0,replicationEndTime=1725433856089,replicationStartTime=1725431257204,sourceReadEndTime=1725433758099,sourceReadStartTime=1725431257248,sourceStateMessagesEmitted=0,discoverSchemaEndTime=<null>,discoverSchemaStartTime=<null>,additionalProperties={}],streamStats=[io.airbyte.config.StreamSyncStats@4866762e[streamName=view_agg_users_lvl1_favourite_categories,streamNamespace=data_platform_gold,stats=io.airbyte.config.SyncStats@73f01fa4[bytesCommitted=0,bytesEmitted=139985069,destinationStateMessagesEmitted=<null>,destinationWriteEndTime=<null>,destinationWriteStartTime=<null>,estimatedBytes=<null>,estimatedRecords=<null>,meanSecondsBeforeSourceStateMessageEmitted=<null>,maxSecondsBeforeSourceStateMessageEmitted=<null>,maxSecondsBetweenStateMessageEmittedandCommitted=<null>,meanSecondsBetweenStateMessageEmittedandCommitted=<null>,recordsEmitted=1031871,recordsCommitted=0,replicationEndTime=<null>,replicationStartTime=<null>,sourceReadEndTime=<null>,sourceReadStartTime=<null>,sourceStateMessagesEmitted=<null>,discoverSchemaEndTime=<null>,discoverSchemaStartTime=<null>,additionalProperties={}],wasBackfilled=<null>,wasResumed=<null>,additionalProperties={}]],performanceMetrics=io.airbyte.config.PerformanceMetrics@569deb1e[additionalProperties={processFromSource={elapsedTimeInNanos=5981281394, executionCount=1031874, avgExecTimeInNanos=5796.523019283362}, readFromSource={elapsedTimeInNanos=44060284532, executionCount=1031875, avgExecTimeInNanos=42699.24606371896}, processFromDest={elapsedTimeInNanos=0, executionCount=0, avgExecTimeInNanos=NaN}, writeToDest={elapsedTimeInNanos=2465821495924, executionCount=1031871, avgExecTimeInNanos=2389660.622232818}, readFromDest={elapsedTimeInNanos=2593414236319, executionCount=218055, avgExecTimeInNanos=1.1893394952278094E7}}],additionalProperties={}],state=<null>,outputCatalog=ConfiguredAirbyteCatalog(streams=[ConfiguredAirbyteStream(stream=AirbyteStream(name=bq_view_agg_users_lvl1_favourite_categories, jsonSchema={"type":"object","properties":{"rank":{"type":"number","airbyte_type":"integer"},"score":{"type":"number","airbyte_type":"integer"},"user_id":{"type":"string"},"favouriteAt":{"type":"string"},"item_parent_category_name":{"type":"string"}},"$schema":"http://json-schema.org/draft-07/schema#"}, supportedSyncModes=[full_refresh, incremental], sourceDefinedCursor=false, defaultCursorField=[], sourceDefinedPrimaryKey=[], namespace=null, isResumable=null), syncMode=full_refresh, destinationSyncMode=overwrite, cursorField=[], primaryKey=[], generationId=null, minimumGenerationId=null, syncId=null, fields=null, mappers=[])]),failures=[io.airbyte.config.FailureReason@5e5cc13d[failureOrigin=destination,failureType=<null>,internalMessage=Destination process exited with non-zero exit code 3,externalMessage=Something went wrong within the destination connector,metadata=io.airbyte.config.Metadata@25700bde[additionalProperties={attemptNumber=4, jobId=9301, connector_command=write}],stacktrace=io.airbyte.workers.internal.exception.DestinationException: Destination process exited with non-zero exit code 3
    at io.airbyte.workers.general.BufferedReplicationWorker.readFromDestination(BufferedReplicationWorker.java:490)
    at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsync$2(BufferedReplicationWorker.java:219)
    at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
    at java.base/java.lang.Thread.run(Thread.java:1583)
,retryable=<null>,timestamp=1725433856053,streamDescriptor=<null>,additionalProperties={}], io.airbyte.config.FailureReason@560e3deb[failureOrigin=replication,failureType=<null>,internalMessage=io.airbyte.workers.exception.WorkerException: Destination process exit with code 3. This warning is normal if the job was cancelled.,externalMessage=Something went wrong during replication,metadata=io.airbyte.config.Metadata@6ff2e92f[additionalProperties={attemptNumber=4, jobId=9301}],stacktrace=java.lang.RuntimeException: io.airbyte.workers.exception.WorkerException: Destination process exit with code 3. This warning is normal if the job was cancelled.
    at io.airbyte.workers.general.BufferedReplicationWorker$CloseableWithTimeout.lambda$close$0(BufferedReplicationWorker.java:535)
    at io.airbyte.workers.general.BufferedReplicationWorker.lambda$runAsyncWithTimeout$5(BufferedReplicationWorker.java:247)
    at java.base/java.util.concurrent.CompletableFuture$AsyncRun.run(CompletableFuture.java:1804)
    at java.base/java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1144)
    at java.base/java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:642)
    at java.base/java.lang.Thread.run(Thread.java:1583)
Caused by: io.airbyte.workers.exception.WorkerException: Destination process exit with code 3. This warning is normal if the job was cancelled.
    at io.airbyte.workers.internal.DefaultAirbyteDestination.close(DefaultAirbyteDestination.java:186)
    at io.airbyte.workers.general.BufferedReplicationWorker$CloseableWithTimeout.lambda$close$0(BufferedReplicationWorker.java:533)
    ... 5 more
,retryable=<null>,timestamp=1725433856056,streamDescriptor=<null>,additionalProperties={}]],additionalProperties={}]
2024-09-04 07:11:26 platform > 
2024-09-04 07:11:26 platform > No post-replication operation(s) to perform.
2024-09-04 07:11:26 platform > ----- START POST REPLICATION OPERATIONS -----
2024-09-04 07:11:26 platform > 
2024-09-04 07:11:26 platform > 
2024-09-04 07:11:26 platform > ----- END POST REPLICATION OPERATIONS -----
2024-09-04 07:11:26 platform > 
2024-09-04 07:11:26 platform > Retry State: RetryManager(completeFailureBackoffPolicy=BackoffPolicy(minInterval=PT10S, maxInterval=PT30M, base=3), partialFailureBackoffPolicy=null, successiveCompleteFailureLimit=5, totalCompleteFailureLimit=10, successivePartialFailureLimit=1000, totalPartialFailureLimit=20, successiveCompleteFailures=5, totalCompleteFailures=5, successivePartialFailures=0, totalPartialFailures=0)
 Backoff before next attempt: 13 minutes 30 seconds
2024-09-04 07:11:26 platform > Failing job: 9301, reason: Job failed after too many retries for connection ef06557a-92d3-41a9-b7da-843a7e984712