search

FREVA-CLINT / freva-nextgen

The next generation Freva
BSD 3-Clause "New" or "Revised" License
0 stars 0 forks source link

Instable Redis Connection #65

Open antarcticrainforest opened 4 weeks ago

antarcticrainforest commented 4 weeks ago

This isn't an issue yet, but I foresee problems in the future:

I noticed when the redis service is restarted the data-loader process stops listing to the broker. Or more likely the other way round, the new broker doesn't send messages to the data-loader. Regardless of which way it works any data loading requests do not end up at the data-loader.

To fix this we have to restart the data-loader process after the redis service has been restarted. Ideally, I'd like to avoid that.

antarcticrainforest commented 4 weeks ago

I guess the problem originates from here. The when the broker is gone the connection becomes dead. When the broker is back again the channel might still remain silent. So I guess we'd have to implement a mechanism that checks if the broker/cache service is still active and if not establish a new connection. If that fails, I guess it should attempt to reconnect and if it still fails assume the broker is dead and fail as well.