SiriDB / siridb-server

SiriDB is a highly-scalable, robust and super fast time series database. Build from the ground up SiriDB uses a unique mechanism to operate without a global index and allows server resources to be added on the fly. SiriDB's unique query language includes dynamic grouping of time series for easy analysis over large amounts of time series.
https://siridb.com
MIT License
506 stars 48 forks source link

Freezing of DB #186

Closed riklempens closed 9 months ago

riklempens commented 11 months ago

We received this this issue from Ubiquiti via email on November 19 2023. It addresses an issue faced in the UISP solution.

Freezing of DB

  • we implemented our own health check for DB which is controlling that DB is healthy
  • it is periodically creating connection to DB, accessing data and testing that there is correct response with reasonable delay
  • I’m not sure with exact details, but it was not rare that DB can suddenly stop responding or start responding with really long delay and it was perfectly ok after restart
  • we have implemented that two years ago and it is rather ok since then
  • it was more problematic with storage which had low I/O performance or in situation when there were a lot of write operations and then suddenly read operation which can lock DB
riklempens commented 11 months ago

We lookup into this issue last week.

Using this documentation we deployed UISP using this command:

curl -fsSL https://uisp.ui.com/v1/install > /tmp/uisp_inst.sh && sudo bash /tmp/uisp_inst.sh

This command installs SiriDB Server 2.0.45.

Question

Is this the version you are using in production?

The Freezing of DB is potentially a pointerbug we fixed in version 2.0.50. Could you please verify if this issue still occurs in version 2.0.50?

riklempens commented 9 months ago

The customer confirmed they are using version 2.0.45, they will test it with 2.0.51. We close this issue for now and will reopen it if the issue still occurs