theonesp / p_zero-code

MIT License
2 stars 1 forks source link

ETL error #25

Open xborrat opened 2 years ago

xborrat commented 2 years ago

admin_events, lab_events, rc_events All data is packed in the last field. ETL error

theonesp commented 2 years ago

admin, lab and rc events have been fixed, let's remove the tables you created? the first row in the talbles with '_1' is the name of the column for all columns

theonesp commented 2 years ago

also I would ask the extraction team, not to include a ';' at the end of the line in each row, could we request that? That last ';' is making the import script confused since it thinks there is an extra column

xborrat commented 2 years ago

I'll do it, I think with nifi it will be easy to remove though.

theonesp commented 2 years ago

it is just that it goes against the csv default, could we ask Gemma? we will not be able to change it manually in files of hundreds of thousands of rows.