alberttwong
commented
1 year ago I tried a much smaller dataset and still has problems.
2023-05-25 17:09:10 [32mINFO[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):222 - Attempt 0 to get state
2023-05-25 17:09:10 [32mINFO[m i.a.w.h.DockerImageNameHelper(extractImageVersion):62 - Could not create semantic version from version latest, message: Invalid version string: latest
2023-05-25 17:09:10 [32mINFO[m i.a.w.h.NormalizationInDestinationHelper(shouldNormalizeInDestination):52 - Requires Normalization: false Normalization Supported: false, Feature Flag Enabled: false
2023-05-25 17:09:10 [32mINFO[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):222 - Attempt 0 to set attempt sync config
2023-05-25 17:09:10 [32mINFO[m i.a.c.t.s.DefaultTaskQueueMapper(getTaskQueue):31 - Called DefaultTaskQueueMapper getTaskQueue for geography auto
2023-05-25 17:09:11 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):136 - Docker volume job log path: /tmp/workspace/8/0/logs.log
2023-05-25 17:09:11 [32mINFO[m i.a.w.t.TemporalAttemptExecution(get):141 - Executing worker wrapper. Airbyte version: 0.44.5
2023-05-25 17:09:11 [32mINFO[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):222 - Attempt 0 to save workflow id for cancellation
2023-05-25 17:09:11 [32mINFO[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):222 - Attempt 0 to get the source for heartbeat
2023-05-25 17:09:11 [32mINFO[m i.a.a.c.AirbyteApiClient(retryWithJitterThrows):222 - Attempt 0 to get the source definition
2023-05-25 17:09:11 [32mINFO[m i.a.w.g.ReplicationWorkerFactory(create):96 - Setting up source...
2023-05-25 17:09:11 [32mINFO[m i.a.w.g.ReplicationWorkerFactory(create):100 - Setting up destination...
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable METRIC_CLIENT: ''
2023-05-25 17:09:11 [33mWARN[m i.a.m.l.MetricClientFactory(initialize):60 - Metric client is already initialized to
2023-05-25 17:09:11 [32mINFO[m i.a.w.g.ReplicationWorkerFactory(create):109 - Setting up replication worker...
2023-05-25 17:09:11 [32mINFO[m i.a.w.g.DefaultReplicationWorker(run):147 - start sync worker. job id: 8 attempt id: 0
2023-05-25 17:09:11 [32mINFO[m i.a.w.g.DefaultReplicationWorker(run):149 - Committing states from replication activity
2023-05-25 17:09:11 [32mINFO[m i.a.w.g.DefaultReplicationWorker(run):152 - Committing stats from replication activity
2023-05-25 17:09:11 [32mINFO[m i.a.c.i.LineGobbler(voidCall):149 -
2023-05-25 17:09:11 [32mINFO[m i.a.w.g.DefaultReplicationWorker(run):168 - configured sync modes: {null.nyctaxi=full_refresh - overwrite}
2023-05-25 17:09:11 [32mINFO[m i.a.c.i.LineGobbler(voidCall):149 - ----- START REPLICATION -----
2023-05-25 17:09:11 [32mINFO[m i.a.w.i.DefaultAirbyteDestination(start):92 - Running destination...
2023-05-25 17:09:11 [32mINFO[m i.a.c.i.LineGobbler(voidCall):149 -
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-05-25 17:09:11 [32mINFO[m i.a.c.i.LineGobbler(voidCall):149 - Checking if atwong/destination-starrocks:latest exists...
2023-05-25 17:09:11 [32mINFO[m i.a.c.i.LineGobbler(voidCall):149 - atwong/destination-starrocks:latest was found locally.
2023-05-25 17:09:11 [32mINFO[m i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = destination-starrocks-write-8-0-iovpo with resources io.airbyte.config.ResourceRequirements@25cf1c79[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts null
2023-05-25 17:09:11 [32mINFO[m i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/8/0 --log-driver none --name destination-starrocks-write-8-0-iovpo --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=atwong/destination-starrocks:latest -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.5 -e WORKER_JOB_ID=8 atwong/destination-starrocks:latest write --config destination_config.json --catalog destination_catalog.json
2023-05-25 17:09:11 [32mINFO[m i.a.w.i.VersionedAirbyteMessageBufferedWriterFactory(createWriter):41 - Writing messages to protocol version 0.2.0
2023-05-25 17:09:11 [32mINFO[m i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-05-25 17:09:11 [32mINFO[m i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-05-25 17:09:11 [32mINFO[m i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/source-file:0.3.4 exists...
2023-05-25 17:09:11 [32mINFO[m i.a.c.i.LineGobbler(voidCall):149 - airbyte/source-file:0.3.4 was found locally.
2023-05-25 17:09:11 [32mINFO[m i.a.w.p.DockerProcessFactory(create):139 - Creating docker container = source-file-read-8-0-dtovg with resources io.airbyte.config.ResourceRequirements@6c18e311[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=,additionalProperties={}] and allowedHosts io.airbyte.config.AllowedHosts@7b78d3a4[hosts=[*, *.datadoghq.com, *.datadoghq.eu, *.sentry.io],additionalProperties={}]
2023-05-25 17:09:11 [32mINFO[m i.a.w.p.DockerProcessFactory(create):192 - Preparing command: docker run --rm --init -i -w /data/8/0 --log-driver none --name source-file-read-8-0-dtovg --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/source-file:0.3.4 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=0 -e OTEL_COLLECTOR_ENDPOINT=http://host.docker.internal:4317 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.44.5 -e WORKER_JOB_ID=8 airbyte/source-file:0.3.4 read --config source_config.json --catalog source_catalog.json
2023-05-25 17:09:11 [32mINFO[m i.a.w.i.VersionedAirbyteStreamFactory(create):181 - Reading messages from protocol version 0.2.0
2023-05-25 17:09:11 [32mINFO[m i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):94 - Starting source heartbeat check. Will check every 1 minutes.
2023-05-25 17:09:11 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromDstRunnable$4):289 - Destination output thread started.
2023-05-25 17:09:11 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):334 - Replication thread started.
2023-05-25 17:09:11 [43mdestination[0m > INFO i.a.i.b.IntegrationCliParser(parseOptions):126 integration args: {catalog=destination_catalog.json, write=null, config=destination_config.json}
2023-05-25 17:09:11 [43mdestination[0m > INFO i.a.i.b.IntegrationRunner(runInternal):108 Running integration: io.airbyte.integrations.destination.starrocks.StarRocksDestination
2023-05-25 17:09:11 [43mdestination[0m > INFO i.a.i.b.IntegrationRunner(runInternal):109 Command: WRITE
2023-05-25 17:09:11 [43mdestination[0m > INFO i.a.i.b.IntegrationRunner(runInternal):110 Integration config: IntegrationConfig{command=WRITE, configPath='destination_config.json', catalogPath='destination_catalog.json', statePath='null'}
2023-05-25 17:09:11 [43mdestination[0m > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-05-25 17:09:11 [43mdestination[0m > WARN c.n.s.JsonMetaSchema(newValidator):278 Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword
2023-05-25 17:09:12 [43mdestination[0m > INFO i.a.i.d.s.StarRocksDestination(getConsumer):61 JsonNode config:
{
"fe_host" : "6dihxzedg.cloud-app.celerdata.com",
"database" : "testparquet",
"password":"**********",
"username" : "admin",
"http_port" : 8030,
"query_port" : 9030
}
2023-05-25 17:09:12 [44msource[0m > Reading nyctaxi (https://d37ci6vzurychx.cloudfront.net/trip-data/green_tripdata_2023-01.parquet)...
2023-05-25 17:09:12 [44msource[0m > TransportParams: None
2023-05-25 17:09:12 [43mdestination[0m > INFO i.a.i.d.b.BufferedStreamConsumer(startTracked):144 class io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer started.
2023-05-25 17:09:12 [43mdestination[0m > INFO i.a.i.d.s.StarRocksBufferedConsumerFactory(lambda$onStartFunction$0):69 Preparing tmp tables in destination started for 1 streams
2023-05-25 17:09:12 [43mdestination[0m > INFO i.a.i.d.s.StarRocksBufferedConsumerFactory(lambda$onStartFunction$0):75 Preparing tmp table in destination started for stream nyctaxi. tmp table name: _airbyte_tmp_bdm_nyctaxi
2023-05-25 17:09:12 [43mdestination[0m > INFO i.a.i.d.s.StarRocksBufferedConsumerFactory(lambda$onStartFunction$0):82 Preparing tmp tables in destination completed.
2023-05-25 17:09:13 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 5000 (2 MB)
2023-05-25 17:09:13 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 10000 (4 MB)
2023-05-25 17:09:14 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 15000 (6 MB)
2023-05-25 17:09:14 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 20000 (8 MB)
2023-05-25 17:09:14 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 25000 (10 MB)
2023-05-25 17:09:15 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 30000 (12 MB)
2023-05-25 17:09:15 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 35000 (14 MB)
2023-05-25 17:09:16 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 40000 (16 MB)
2023-05-25 17:09:16 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 45000 (18 MB)
2023-05-25 17:09:16 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 50000 (20 MB)
2023-05-25 17:09:17 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 55000 (22 MB)
2023-05-25 17:09:17 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 60000 (24 MB)
2023-05-25 17:09:18 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(processMessageFromSource):87 - Records read: 65000 (26 MB)
2023-05-25 17:09:18 [32mINFO[m i.a.w.g.DefaultReplicationWorker(lambda$readFromSrcAndWriteToDstRunnable$5):361 - Source has no more messages, closing connection.
2023-05-25 17:09:18 [32mINFO[m i.a.w.g.ReplicationWorkerHelper(endOfSource):62 - Total records read: 68211 (28 MB)
2023-05-25 17:09:18 [32mINFO[m i.a.w.i.FieldSelector(reportMetrics):122 - Schema validation was performed to a max of 10 records with errors per stream.
2023-05-25 17:09:18 [33mWARN[m i.a.w.i.FieldSelector(lambda$reportMetrics$1):124 - Schema validation errors found for stream _nyctaxi. Error messages: [$.lpep_dropoff_datetime: 2023-01-01T00:57:49 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:41:32 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T01:08:23 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:59:47 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:41:29 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:49:34 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T01:17:35 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:41:43 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:10:45 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:21:50 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T01:11:04 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:13:14 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:16:02 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:11:58 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:26:39 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:35:11 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:26:32 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:55:13 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:19:37 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:41:56 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:08:43 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:41:25 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:45:31 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T01:13:42 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:39:32 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:31:06 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:09:14 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:30:26 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:46:26 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:33:04 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:18:35 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:26:21 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:17:08 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:51:03 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:37:11 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:30:09 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:24:55 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:50:32 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:19:03 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:42:23 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:16:12 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T01:18:06 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:14:37 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:39:02 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:32:02 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:01:31 is an invalid date-time, $.lpep_dropoff_datetime: 2023-01-01T00:46:06 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:26:10 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:35:12 is an invalid date-time, $.lpep_pickup_datetime: 2023-01-01T00:53:31 is an invalid date-time]
2023-05-25 17:09:18 [32mINFO[m i.a.w.i.HeartbeatTimeoutChaperone(runWithHeartbeatThread):111 - thread status... heartbeat thread: false , replication thread: true
2023-05-25 17:09:18 [32mINFO[m i.a.w.g.DefaultReplicationWorker(replicate):248 - Waiting for source and destination threads to complete.
2023-05-25 17:09:18 [32mINFO[m i.a.w.g.DefaultReplicationWorker(replicate):253 - One of source or destination thread complete. Waiting on the other.
2023-05-25 17:09:18 [43mdestination[0m > INFO i.a.i.b.FailureTrackingAirbyteMessageConsumer(close):80 Airbyte message consumer: succeeded.
2023-05-25 17:09:18 [43mdestination[0m > INFO i.a.i.d.b.BufferedStreamConsumer(close):255 executing on success close procedure.
2023-05-25 17:09:18 [43mdestination[0m > INFO i.a.i.d.r.InMemoryRecordBufferingStrategy(flushAllBuffers):85 Flushing nyctaxi: 68211 records (113 MB)
2023-05-25 17:09:23 [43mdestination[0m > WARN i.a.i.d.s.DefaultStreamLoader(testHttpConnection):182 Failed to connect to address:6dihxzedg.cloud-app.celerdata.com java.net.SocketTimeoutException: Connect timed out
at sun.nio.ch.NioSocketImpl.timedFinishConnect(NioSocketImpl.java:546) ~[?:?]
at sun.nio.ch.NioSocketImpl.connect(NioSocketImpl.java:597) ~[?:?]
at java.net.Socket.connect(Socket.java:633) ~[?:?]
at sun.net.NetworkClient.doConnect(NetworkClient.java:178) ~[?:?]
at sun.net.www.http.HttpClient.openServer(HttpClient.java:532) ~[?:?]
at sun.net.www.http.HttpClient.openServer(HttpClient.java:637) ~[?:?]
at sun.net.www.http.HttpClient.<init>(HttpClient.java:280) ~[?:?]
at sun.net.www.http.HttpClient.New(HttpClient.java:385) ~[?:?]
at sun.net.www.http.HttpClient.New(HttpClient.java:407) ~[?:?]
at sun.net.www.protocol.http.HttpURLConnection.getNewHttpClient(HttpURLConnection.java:1309) ~[?:?]
at sun.net.www.protocol.http.HttpURLConnection.plainConnect0(HttpURLConnection.java:1242) ~[?:?]
at sun.net.www.protocol.http.HttpURLConnection.plainConnect(HttpURLConnection.java:1128) ~[?:?]
at sun.net.www.protocol.http.HttpURLConnection.connect(HttpURLConnection.java:1057) ~[?:?]
at io.airbyte.integrations.destination.starrocks.DefaultStreamLoader.testHttpConnection(DefaultStreamLoader.java:178) ~[io.airbyte.airbyte-integrations.connectors-destination-starrocks-0.44.4.jar:?]
at io.airbyte.integrations.destination.starrocks.DefaultStreamLoader.getAvailableHost(DefaultStreamLoader.java:163) ~[io.airbyte.airbyte-integrations.connectors-destination-starrocks-0.44.4.jar:?]
at io.airbyte.integrations.destination.starrocks.DefaultStreamLoader.send(DefaultStreamLoader.java:91) ~[io.airbyte.airbyte-integrations.connectors-destination-starrocks-0.44.4.jar:?]
at io.airbyte.integrations.destination.starrocks.StarRocksBufferedConsumerFactory.lambda$recordWriterFunction$2(StarRocksBufferedConsumerFactory.java:100) ~[io.airbyte.airbyte-integrations.connectors-destination-starrocks-0.44.4.jar:?]
at io.airbyte.integrations.destination.record_buffer.InMemoryRecordBufferingStrategy.flushAllBuffers(InMemoryRecordBufferingStrategy.java:87) ~[io.airbyte.airbyte-integrations.bases-base-java-0.44.4.jar:?]
at io.airbyte.integrations.destination.buffered_stream_consumer.BufferedStreamConsumer.close(BufferedStreamConsumer.java:258) ~[io.airbyte.airbyte-integrations.bases-base-java-0.44.4.jar:?]
at io.airbyte.integrations.base.FailureTrackingAirbyteMessageConsumer.close(FailureTrackingAirbyteMessageConsumer.java:82) ~[io.airbyte.airbyte-integrations.bases-base-java-0.44.4.jar:?]
at io.airbyte.integrations.base.IntegrationRunner.runInternal(IntegrationRunner.java:152) ~[io.airbyte.airbyte-integrations.bases-base-java-0.44.4.jar:?]
at io.airbyte.integrations.base.IntegrationRunner.run(IntegrationRunner.java:101) ~[io.airbyte.airbyte-integrations.bases-base-java-0.44.4.jar:?]
at io.airbyte.integrations.destination.starrocks.StarRocksDestination.main(StarRocksDestination.java:42) ~[io.airbyte.airbyte-integrations.connectors-destination-starrocks-0.44.4.jar:?]
liuzhongjun89
Source: parquet file from NYC taxi - https://d37ci6vzurychx.cloudfront.net/trip-data/yellow_tripdata_2023-01.parquet. Target: StarRocks.