pingcap / ng-monitoring

Apache License 2.0
30 stars 22 forks source link

TopSQL's retention time does not work #127

Open lilyjazz opened 2 years ago

lilyjazz commented 2 years ago

Bug Report

Please answer these questions before submitting your issue. Thanks!

What did you do?

Open topsql feature from March 21.

What did you expect to see?

topsql's retention time is 1 month and it does work, it should delete data that exceed retention time.

What did you see instead?

data for march 21 is still available.

What version of TiDB Dashboard are you using (./tidb-dashboard --version)?

6.0

kbNIPG4cUQ

This issue is from https://github.com/pingcap/tidb-dashboard/issues/1218

zhongzc commented 2 years ago

Victoria-metrics does not clean up stale data in a partition in which still some valid data, so those stale data are visible before all data in that partition become stale.

Yesterday the part /data2/production/prometheus-9090/data/tsdb/data/small/2022_03/300830982_1104130_20220320163212.000_20220324122734.000_16DC81B605210EBA was removed by VM, data are as expected. image