MeltanoLabs / tap-jira

Other
1 stars 14 forks source link

Failed validating 'type' in schema['properties']['fields__resolution'] #53

Open akoebbe-uu opened 10 months ago

akoebbe-uu commented 10 months ago

I'm very new to Meltano so please forgive me if this is an obvious mistake. I'm getting the following error when doing an elt from Jira (meltanolab) to a Postgres target.

2023-11-11T21:56:43.562904Z [info     ]   File "/projects/.meltano/loaders/target-postgres/venv/lib/python3.9/site-packages/jsonschema/validators.py", line 435, in validate cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.563281Z [info     ]     raise error                cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.563654Z [info     ] jsonschema.exceptions.ValidationError: None is not of type 'string' cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.564037Z [info     ]                                cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.564354Z [info     ] Failed validating 'type' in schema['properties']['fields__resolution']: cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.564736Z [info     ]     {'type': 'string'}         cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.565200Z [info     ]                                cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.565575Z [info     ] On instance['fields__resolution']: cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.565939Z [info     ]     None                       cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.639640Z [debug    ] Deleted configuration at /projects/.meltano/run/elt/2023-11-11T215514--tap-jira--target-postgres/b745d180-a240-4ea1-86c7-e26244bcb164/target.7e61622e-bd37-4fae-b887-901d08546b58.config.json
2023-11-11T21:56:43.640188Z [debug    ] Deleted configuration at /projects/.meltano/run/elt/2023-11-11T215514--tap-jira--target-postgres/b745d180-a240-4ea1-86c7-e26244bcb164/tap.44a0d476-1c07-49ee-8862-bfd7dbf9d174.config.json
2023-11-11T21:56:43.640400Z [error    ] Loading failed                 code=1 message=    None name=meltano run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres
2023-11-11T21:56:43.724791Z [debug    ] ELT could not be completed: Loader failed.

Here's the relevant snippet from my meltano.yml

default_environment: dev
environments:
  - name: dev
  config:
    plugins:
      extractors:
      - name: tap-jira
        select:
        - boards.*
        - sprints.*
        - '!issues.fields.customfield*'
        - '!issues.fields.parent.fields.*'
        - workflow_statuses.
        - issues.*
        - projects.id
        - projects.name
        - projects.key
        - workflow_statuses.*
        - boards.*
        - issue_types.*
plugins:
  extractors:
  - name: tap-jira
    variant: meltanolabs
    pip_url: git+https://github.com/MeltanoLabs/tap-jira.git
    config:
      domain: [redacted]
      flattening_enabled: true
      flattening_max_depth: 1
akoebbe-uu commented 10 months ago

FWIW it does not error out when flattening is disabled.