search

airbytehq / airbyte

The leading data integration platform for ETL / ELT data pipelines from APIs, databases & files to data warehouses, data lakes & data lakehouses. Both self-hosted and Cloud-hosted.
https://airbyte.com
Other
16.1k stars 4.12k forks source link

Connector Issue: Amazon Seller Partner for FBA_MYI_UNSUPRESSED_INVENTORY #25411

Closed Skorkmaz88 closed 10 months ago

Skorkmaz88 commented 1 year ago

Connector Name

airbyte/source-amazon-seller-partner

Connector Version

0.2.23

What step the error happened?

During the sync

Revelant information

GET_FBA_MYI_UNSUPPRESSED_INVENTORY report fails with the log below

Relevant log output

..
2023-04-22 09:09:12 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/1524/1 --log-driver none --name us-amazon-sp-api-check-1524-1-boxgy --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=mdf/us-amazon-sp-api:dev -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.1 -e WORKER_JOB_ID=1524 mdf/us-amazon-sp-api:dev check --config source_config.json
2023-04-22 09:09:12 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):110 - Reading messages from protocol version 0.2.0
2023-04-22 09:09:17 INFO i.a.w.i.DefaultAirbyteStreamFactory(internalLog):194 - Check succeeded
2023-04-22 09:09:17 INFO i.a.w.g.DefaultCheckConnectionWorker(run):120 - Check connection job received output: io.airbyte.config.StandardCheckConnectionOutput@382edf60[status=succeeded,message=<null>]
2023-04-22 09:09:17 INFO i.a.w.t.TemporalAttemptExecution(get):169 - Stopping cancellation check scheduling...
2023-04-22 09:09:17 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-04-22 09:09:17 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- END CHECK -----
2023-04-22 09:09:17 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-04-22 09:09:17 INFO i.a.w.t.TemporalAttemptExecution(get):142 - Docker volume job log path: /tmp/workspace/1524/1/logs.log
2023-04-22 09:09:17 INFO i.a.w.t.TemporalAttemptExecution(get):147 - Executing worker wrapper. Airbyte version: 0.42.1
2023-04-22 09:09:17 INFO i.a.a.c.AirbyteApiClient(retryWithJitter):179 - Attempt 0 to save workflow id for cancellation
2023-04-22 09:09:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_LIMIT: '2.0'
2023-04-22 09:09:17 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-04-22 09:09:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_LIMIT: '2.0'
2023-04-22 09:09:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SIDECAR_KUBE_CPU_REQUEST: '0.1'
2023-04-22 09:09:17 INFO i.a.c.i.LineGobbler(voidCall):149 - ----- START CHECK -----
2023-04-22 09:09:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable SOCAT_KUBE_CPU_REQUEST: '0.1'
2023-04-22 09:09:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable LAUNCHDARKLY_KEY: ''
2023-04-22 09:09:17 INFO i.a.c.i.LineGobbler(voidCall):149 - 
2023-04-22 09:09:17 INFO i.a.c.EnvConfigs(getEnvOrDefault):1222 - Using default value for environment variable FEATURE_FLAG_CLIENT: ''
2023-04-22 09:09:18 INFO i.a.c.i.LineGobbler(voidCall):149 - Checking if airbyte/destination-mysql:0.1.20 exists...
2023-04-22 09:09:18 INFO i.a.c.i.LineGobbler(voidCall):149 - airbyte/destination-mysql:0.1.20 was found locally.
2023-04-22 09:09:18 INFO i.a.w.p.DockerProcessFactory(create):130 - Creating docker container = destination-mysql-check-1524-1-eahao with resources io.airbyte.config.ResourceRequirements@3ad3c5bd[cpuRequest=,cpuLimit=,memoryRequest=,memoryLimit=] and allowedHosts null
2023-04-22 09:09:18 INFO i.a.w.p.DockerProcessFactory(create):175 - Preparing command: docker run --rm --init -i -w /data/1524/1 --log-driver none --name destination-mysql-check-1524-1-eahao --network host -v airbyte_workspace:/data -v /tmp/airbyte_local:/local -e DEPLOYMENT_MODE=OSS -e WORKER_CONNECTOR_IMAGE=airbyte/destination-mysql:0.1.20 -e AUTO_DETECT_SCHEMA=true -e LAUNCHDARKLY_KEY= -e SOCAT_KUBE_CPU_REQUEST=0.1 -e SOCAT_KUBE_CPU_LIMIT=2.0 -e USE_STREAM_CAPABLE_STATE=true -e FIELD_SELECTION_WORKSPACES= -e AIRBYTE_ROLE= -e WORKER_ENVIRONMENT=DOCKER -e APPLY_FIELD_SELECTION=false -e WORKER_JOB_ATTEMPT=1 -e FEATURE_FLAG_CLIENT= -e AIRBYTE_VERSION=0.42.1 -e WORKER_JOB_ID=1524 airbyte/destination-mysql:0.1.20 check --config source_config.json
2023-04-22 09:09:18 INFO i.a.w.i.VersionedAirbyteStreamFactory(create):110 - Reading messages from protocol version 0.2.0
2023-04-22 09:09:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Class path contains multiple SLF4J bindings.
2023-04-22 09:09:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/log4j-slf4j-impl-2.17.1.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2023-04-22 09:09:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2023-04-22 09:09:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Found binding in [jar:file:/airbyte/lib/logback-classic-1.2.3.jar!/org/slf4j/impl/StaticLoggerBinder.class]
2023-04-22 09:09:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
2023-04-22 09:09:18 ERROR i.a.c.i.LineGobbler(voidCall):149 - SLF4J: Actual binding is of type [org.apache.logging.slf4j.Log4jLoggerFactory]
2023-04-22 09:09:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessageNew):140 - Deserialization failed: "2023-04-22 09:09:19 \u001B[32mINFO\u001B[m i.a.i.d.m.MySQLDestination(main):136 - starting destination: class io.airbyte.integrations.destination.mysql.MySQLDestination"
2023-04-22 09:09:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessageNew):140 - Deserialization failed: "2023-04-22 09:09:19 \u001B[32mINFO\u001B[m i.a.i.b.IntegrationCliParser(parseOptions):118 - integration args: {check=null, config=source_config.json}"
2023-04-22 09:09:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessageNew):140 - Deserialization failed: "2023-04-22 09:09:19 \u001B[32mINFO\u001B[m i.a.i.b.IntegrationRunner(runInternal):123 - Running integration: io.airbyte.integrations.base.ssh.SshWrappedDestination"
2023-04-22 09:09:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessageNew):140 - Deserialization failed: "2023-04-22 09:09:19 \u001B[32mINFO\u001B[m i.a.i.b.IntegrationRunner(runInternal):124 - Command: CHECK"
2023-04-22 09:09:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessageNew):140 - Deserialization failed: "2023-04-22 09:09:19 \u001B[32mINFO\u001B[m i.a.i.b.IntegrationRunner(runInternal):125 - Integration config: IntegrationConfig{command=CHECK, configPath='source_config.json', catalogPath='null', statePath='null'}"
2023-04-22 09:09:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessageNew):140 - Deserialization failed: "2023-04-22 09:09:19 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword order - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"
2023-04-22 09:09:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessageNew):140 - Deserialization failed: "2023-04-22 09:09:19 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword examples - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"
2023-04-22 09:09:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessageNew):140 - Deserialization failed: "2023-04-22 09:09:19 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword airbyte_secret - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"
2023-04-22 09:09:19 ERROR i.a.w.i.DefaultAirbyteStreamFactory(toAirbyteMessageNew):140 - Deserialization failed: "2023-04-22 09:09:19 \u001B[33mWARN\u001B[m c.n.s.JsonMetaSchema(newValidator):338 - Unknown keyword multiline - you should define your own Meta Schema. If the keyword is irrelevant for validation, just use a NonValidationKeyword"

Contribute

artem1205 commented 12 months ago

Hi, @Skorkmaz88 ,

please provide full log and your steps. Log output from issue description is not enough to identify the problem.

askarpets commented 11 months ago

Hello @Skorkmaz88, Would you be able to provide the full log asked by @artem1205? Thank you!

artem1205 commented 10 months ago

Closing for now, will reopen if needed