search

medic / cht-sync

Data synchronization between CouchDB and PostgreSQL for the purpose of analytics.
GNU General Public License v3.0
4 stars 5 forks source link

fix missing values in redis worker #92

Closed witash closed 6 months ago

witash commented 7 months ago

@njuguna-n please review; turns out postgrest doesn't like missing values. I'm not sure how this was working before, maybe it was silently failing? Now it is loudly failing because postgrest returns 400 for these requests, meaning the redis worker doesn't move on and just hangs retrying in the queue.

Also moved initializing the DB to the dbt initialization script. this isn't the right place for it really but there was already some initialization there (creating the schema) so for now just moving it there.

witash commented 6 months ago

linked to #97

leaving this open for now while I look into why the missing values are ocurring

witash commented 6 months ago

replaced by https://github.com/medic/cht-sync/pull/98