Retain prometheus data for more months than we do now

jupyterhub / mybinder.org-deploy

Deployment config files for mybinder.org

https://mybinder-sre.readthedocs.io/en/latest/index.html

BSD 3-Clause "New" or "Revised" License

76 stars 74 forks source link

Retain prometheus data for more months than we do now #415

Open choldgraf opened 6 years ago

choldgraf commented 6 years ago

Our prometheus data is awesome, and is a trove of valuable information regarding the mybinder.org deployment and how people are using it.

Unfortunately, right now we're only retaining about a week or so's worth of data. We should do:

Increase the retention time of prometheus data (this is a stop-gap solution)
Connect prometheus with remote data storage (info here)

yuvipanda commented 6 years ago

We currently keep 2 months, but I agree with everything else!

In about another month, we should look at how much disk the current prometheus data is using, what CPU performance during queries is like, and bump it to 3 months if they look ok.