Extracting Tasks: KeyError: 'date_updated'

[leo-neves]

I am having some problems to get tasks, I'm getting the following KeyError, so it stops the extraction. Is that any known issue?

[info ] KeyError: 'date_updated' cmd_type=elb consumer=False name=tap-clickup producer=True stdio=stderr string_id=tap-clickup [error ] Extractor failed [error ] Block run completed. block_type=ExtractLoadBlocks err=RunnerError('Extractor failed') exit_codes={<PluginType.EXTRACTORS: 'extractors'>: 1} set_number=0 success=False

Any idea of what could be happening?

Thanks in advance

[sebastianswms]

This is not a known issue, and I can't immediately replicate the behavior you're experiencing. Could you please provide more information about the specific configuration you're using and the data you're attempting to extract?

[leo-neves]

Thank you for answering, @sebastianswms, I'm extracting the data with the tap-clickup on meltano. I am using the latest version of python, meltano and of the dependencies. I need to get most of the attributes from tasks, specially ids, statuses, time spent and time estimated. If I get data from spaces or folders, it works fine, the only issue I faced was with tasks.

[sebastianswms]

I'm still having trouble replicating your problem. Could you provide more detailed steps to recreate your problem?

[leo-neves]

@sebastianswms took me a while to get back here, I'm using the following config for the plugin

`plugins: extractors:

• name: tap-clickup variant: autoidm pip_url: tap-clickup select:

  • task.name`

  My python version is 3.10.11, meltano version 2.19.1, running it on Powershell on Windows 10 Pro. I only runned meltano run tap-clickup target-csv command and got the error, tried with different targets as well.

[visch]

Oh I see @leo-neves , add to your select statement task.date_updated we require it due to incremental streams right now. Ideally we'd auto select it for you! Does that work @leo-neves?

Also note a really easy way to do this is just task.* and select all the task fields

I think a later version of the meltano sdk fixes this but if we upgrade we should be careful @sebastianswms due to https://github.com/AutoIDM/tap-clickup/blob/main/tap_clickup/client.py#L137 but upgrading this would eliminate this issue

[visch]

@sebastianswms Looks like you already bumped that with your last PR. We also need to cut a release to pypi and then I think @leo-neves could just update and we'd be good

[leo-neves]

Thanks heaps @visch, that worked like a charm. Cheers

[leo-neves]

@visch there's a way to get a not incremental stream for tasks, a full load when needed?

[visch]

@leo-neves I don't understand what you're asking, sorry :(

Please open a seperate issue with some more details!