graphite-project / graphite-web

A highly scalable real-time graphing system
http://graphite.readthedocs.org/
Apache License 2.0
5.89k stars 1.26k forks source link

[BUG] Long whisper files fail to render more than 7d of history #2688

Closed lachesis closed 3 years ago

lachesis commented 3 years ago

Describe the bug I have some carbon/whisper files with many years of history. When I try to render more than 7 days worth of data from these metrics, I get back a graph with only one or two points towards the very end. Using whisper-dump.py, I am able to see all of my historical data is intact. My storage schemas are:

[default]
pattern = .*
retentions = 10s:7d,10m:60d,1h:5y,4h:10y

To Reproduce

  1. Unzip the attached WSP file and provide it to Graphite in storage/stats/gauges/ups/load.wsp. load.wsp.zip
  2. Hit the render API for 7 days. Note all points are intact. http://localhost:3081/render?target=stats.gauges.ups.load&from=-7d&until=now&format=json
  3. Hit the render API for 30 days. Note only one point is returned. http://localhost:3081/render?target=stats.gauges.ups.load&from=-30d&until=now&format=json

Expected behavior I'd expect to see data from all 30 days.

Screenshots Screenshots of graph in Grafana, but I've minimized this problem to be occurring in graphite-web. 2021-03-29-135526_2125x548_scrot 2021-03-29-135516_2135x553_scrot

Environment (please complete the following information):

Additional context This doesn't happen exactly the same way for every metric. Some other metrics include early data but no newer data.

deniszh commented 3 years ago

I can reproduce but I'm suspecting something is wrong with file itself. it contains 3 archives instead of 4 (10s:7d,10m:60d,1h:5y), whisper-dump shows data, and data looks valid. But whisper-fetch shows exactly same result as Graphite for second archive for some reason...

stale[bot] commented 3 years ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed if no further activity occurs. Thank you for your contributions.