start_datetime is required argument even with start_datetime in tap_config.json

anelendata / tap-bigquery

Singer.io tap for extracting data from BigQuery tables

Apache License 2.0

16 stars 33 forks source link

start_datetime is required argument even with start_datetime in tap_config.json #15

Closed dusty-campanella-maxa closed 3 years ago

dusty-campanella-maxa commented 4 years ago

The project documentation is saying :

"start_datetime must also be set in the config file or as the command line argument",

but I have an "state or start_datetime must be specified" error even if I have a specified start_datetime in my tap_config.json

Thanks,

Dusty

daigotanaka commented 4 years ago

Hi @dustymaxa,

Can I see your config? You should mask password or any sensitive info. I just need to see the format you are using.

Also please make sure you are using version v0.3.2 (or later in case I released something after this post). To update:

pip install -U tap-bigquery

(Related (closed) issue: https://github.com/anelendata/tap-bigquery/issues/11 )

Daigo

dusty-campanella-maxa commented 4 years ago

HI @daigotanaka ,

Here is my tap_config file and the results of the discovery command. I'm using the v0.3.2.

Thanks,

Dusty

daigotanaka commented 4 years ago

Yes, I confirmed this is a bug. Thanks for reporting. The workaround is to specify --start_datetime "2019-09-23T00:00:00Z" in the command line for both discovery mode and sync mode. Meanwhile, I'm fixing it now. Sorry for the inconvenience.