search

thingsboard / thingsboard

Open-source IoT Platform - Device management, data collection, processing and visualization.
https://thingsboard.io
Apache License 2.0
17.54k stars 5.18k forks source link

Limit disk usage when deleting data to prevent service freeze #11874

Open jortega11 opened 3 weeks ago

jortega11 commented 3 weeks ago

Component

Description I have a device with a lot of data from different telemetries. They were for testing purposes so I wanted to delete them. I noticed that my Thingsboard froze when I did that, so I check my task manager where I have my TB virtual machine and saw that my SSD Disk was working at 100%, because it was probably running the query that was deleting the telemetry data. Right after it finished, everything began working as usual and the disk usage returned to normal values.

Is there a way to prevent Thingsboard from freezing? Because all the devices I had lost connection when this was happening and I would like to know if there is a solution for this so I can prevent issues in the future.

Environment

Ultrazombie commented 2 weeks ago

Hello @jortega11 What size telemetry are you deleting? How many input-output operations per second are used during deletion? (sudo apt install iotop && sudo iotop)

Or, can you provide some steps to reproduce this behavior?

jortega11 commented 2 weeks ago

It was a telemetry that was being sent every second for a month. I tried removing that telemetry on another device the day after and it performed better. My Thingsboard instance is deployed in a Ubuntu VM in a Windows computer. Maybe that was caused because the computer was doing something in the background. I do not know exactly how to replicate this issue because of that, while deleting the telemetries in the other devices it was performing better. So that is why I wanted to ask if there is a limit that can be set to prevent the service from freezing.