search

toluaina / pgsync

Postgres to Elasticsearch/OpenSearch sync
https://pgsync.com
MIT License
1.11k stars 174 forks source link

If I add new data when redis pod is down and restart redis it doesn't sync #385

Closed goktugbati closed 10 months ago

goktugbati commented 1 year ago

PGSync version: latest

Elasticsearch version:

Redis version: latest

Python version: 3.7

Problem Description: I was testing a failure scenario and I'm using a materialized view.\ Materialized view didn't refresh when I tested the following steps 1.Kill redis pod 2.Add new data 3.Restart redis 4.Make sure pgsync is up and running again 5.Check elasticsearch and the materialized view 6.Materialized view did not contain the data that was added in step 2. 7.Refreshed the materialized view manually and saw that the data was added to elastic search

toluaina commented 1 year ago

Sorry is this an underlying issue with running with kubernetes or just a problem with materialized view support.

Can you confirm if this failure scenario works with or without a materialzed view?

toluaina commented 1 year ago

adding new data when the redis pod is down should be fine as long as pgsync itself is also down. pgsync will NOT run without redis anyway.