search

qoollo / bob

Distributed BLOB storage
MIT License
28 stars 3 forks source link

Bob's RPS value doesn't drop over time #869

Open archeoss opened 6 months ago

archeoss commented 6 months ago

Description

Currently, Bob's RPS value doesn't drop over time and stuck to last recorded value. This includes per node RPS metric and cluster-wise RPS metric.

To Reproduce

  1. Start BOB cluster
  2. Start bobp tool to write into cluster
  3. Request metrics from bob

Screenshots

image_2024-03-03_03-47-25

ikopylov commented 6 months ago

Problematic code here: https://github.com/qoollo/bob/blob/master/bob-common/src/metrics/exporters/global_exporter/rate_processor.rs

It should be resolved during metrics refactoring. Related issues: https://github.com/qoollo/bob/issues/628 and https://github.com/qoollo/bob/issues/689