MeltanoLabs / tap-jira

Other
1 stars 15 forks source link

Failed validating 'type' in schema['properties']['fields__resolution'] #53

Open akoebbe-uu opened 1 year ago

akoebbe-uu commented 1 year ago

I'm very new to Meltano so please forgive me if this is an obvious mistake. I'm getting the following error when doing an elt from Jira (meltanolab) to a Postgres target.

2023-11-11T21:56:43.562904Z [info     ]   File "/projects/.meltano/loaders/target-postgres/venv/lib/python3.9/site-packages/jsonschema/validators.py", line 435, in validate cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.563281Z [info     ]     raise error                cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.563654Z [info     ] jsonschema.exceptions.ValidationError: None is not of type 'string' cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.564037Z [info     ]                                cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.564354Z [info     ] Failed validating 'type' in schema['properties']['fields__resolution']: cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.564736Z [info     ]     {'type': 'string'}         cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.565200Z [info     ]                                cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.565575Z [info     ] On instance['fields__resolution']: cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.565939Z [info     ]     None                       cmd_type=loader name=target-postgres run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres stdio=stderr
2023-11-11T21:56:43.639640Z [debug    ] Deleted configuration at /projects/.meltano/run/elt/2023-11-11T215514--tap-jira--target-postgres/b745d180-a240-4ea1-86c7-e26244bcb164/target.7e61622e-bd37-4fae-b887-901d08546b58.config.json
2023-11-11T21:56:43.640188Z [debug    ] Deleted configuration at /projects/.meltano/run/elt/2023-11-11T215514--tap-jira--target-postgres/b745d180-a240-4ea1-86c7-e26244bcb164/tap.44a0d476-1c07-49ee-8862-bfd7dbf9d174.config.json
2023-11-11T21:56:43.640400Z [error    ] Loading failed                 code=1 message=    None name=meltano run_id=b745d180-a240-4ea1-86c7-e26244bcb164 state_id=2023-11-11T215514--tap-jira--target-postgres
2023-11-11T21:56:43.724791Z [debug    ] ELT could not be completed: Loader failed.

Here's the relevant snippet from my meltano.yml

default_environment: dev
environments:
  - name: dev
  config:
    plugins:
      extractors:
      - name: tap-jira
        select:
        - boards.*
        - sprints.*
        - '!issues.fields.customfield*'
        - '!issues.fields.parent.fields.*'
        - workflow_statuses.
        - issues.*
        - projects.id
        - projects.name
        - projects.key
        - workflow_statuses.*
        - boards.*
        - issue_types.*
plugins:
  extractors:
  - name: tap-jira
    variant: meltanolabs
    pip_url: git+https://github.com/MeltanoLabs/tap-jira.git
    config:
      domain: [redacted]
      flattening_enabled: true
      flattening_max_depth: 1
akoebbe-uu commented 1 year ago

FWIW it does not error out when flattening is disabled.