singer-io / target-csv

Write Singer data to CSV files
GNU Affero General Public License v3.0
37 stars 68 forks source link

did not generate excel file #21

Open munishase opened 5 years ago

munishase commented 5 years ago

after setting up all as per instructions, it seems ran well, but did not generate the excel. because it remain schema & state. I tried to change state to record by manually but then it gives error. below is the response when I ran the provided code, I just print additional logger.info(message_type)

INFO Replicating exchange rate data from exchangeratesapi.io starting from 2019-07-10 INFO SCHEMA INFO {'start_date': '2019-07-10'} INFO STATE {"start_date": "2019-07-10"}

joaopcoelho commented 5 years ago

I have the same issue. Setting both tap and target as explained in this repo's readme and running ~/.virtualenvs/tap-exchangeratesapi/bin/tap-exchangeratesapi | ~/.virtualenvs/target-csv/bin/target-csv results in:

INFO Sending version information to singer.io. To disable sending anonymous usage data, set the config parameter "disable_collection" to true
INFO Replicating exchange rate data from exchangeratesapi.io starting from 2019-08-07
INFO Tap exiting normally
{"start_date": "2019-08-07"}

Looking a the target-csv code, it seems the expected CSV file is created when a message of type "RECORD" is passed. But when running the tap only (without piping to the target-csv), there doesn't seem to be any "RECORD" message present. This is the output when running ~/.virtualenvs/tap-exchangeratesapi/bin/tap-exchangeratesapi:

INFO Replicating exchange rate data from exchangeratesapi.io starting from 2019-08-07
{"type": "SCHEMA", "stream": "exchange_rate", "schema": {"type": "object", "properties": {"date": {"type": "string", "format": "date-time"}}, "additionalProperties": true}, "key_properties": ["date"]}
{"type": "STATE", "value": {"start_date": "2019-08-07"}}
INFO Tap exiting normally

So maybe this is an issue with the tap rather than the target. In any case, sharing here since the problem had been brought up already. Any thoughts on how to get this to work are appreciated :)

joaopcoelho commented 5 years ago

So the problem here was that a configuration file is required for the tap. Doing

.virtualenvs/tap-exchangeratesapi/bin/tap-exchangeratesapi -c config.json | .virtualenvs/target-csv/bin/target-csv

worked, where config.json is a copy of the sample in the tap-exchangeratesapi repo.