search

medic / cht-sync

Data synchronization between CouchDB and PostgreSQL for the purpose of analytics.
GNU General Public License v3.0
4 stars 5 forks source link

Deal with missing values in redis worker #97

Closed witash closed 6 months ago

witash commented 6 months ago

Logstash sometimes sends requests where the body doesn't include the full doc. This causes problems with the redis worker because either postgrest refuses these requests, or if we add default values, inserts them with null values, whihc is not useful.

What are these partial requests coming from logstash? Why are they only affecting the redis worker, shouldn't postgrest have rejected them straight from logstash? How best to handle them in the redis worker?

andrablaj commented 6 months ago

Closing this issue because Redis will be removed in the next CHT Sync iteration.