oetiker / rrdtool-2.x

RRDtool 2.x - The Time Series Database
88 stars 8 forks source link

Ability to insert data at irregular intervals #2

Open dukelion opened 11 years ago

dukelion commented 11 years ago

It would be nice, if RRD allows to insert data with different intervals. It will be useful to have real-time graph, but store only 5 min measures in a long run.

oetiker commented 11 years ago

please give an example.

with rrdtool today you can setup a short RRA with high resolution and a longer one with 5 minute resolution. you then update with high frequency -> real time graph.

dukelion commented 11 years ago

For example, if you use pinba (http://pinba.org/wiki/Main_Page) as a source of data. Measure results come in real time, and you cannot set an exact time interval. So it will be more convenient to aggregate data in RRD, not cache them and put to database on timer. This is main reason we do not use RRD for some of monitoring metrics. Here is RRD descendant, implementing this: http://graphite.wikidot.com/whisper

oetiker commented 11 years ago

but rrd tool has (and never had) any problems with data arriving at irregular intervals ... it actually resamples the data as it comes in, this was a prime design requirement from the very start ...

or do you mean that your data does not arrive in sequence ?

dukelion commented 11 years ago

Sorry, maybe it's not rrdtool flaw, but in our collectd server only last passed interval is displayed. I'd like to see last few measures as detailed as possible, regardless of the rrd interval. And non-sequential updates is also a good thing to have ( if it doesn't hurt anything else)

oetiker commented 11 years ago

the non-sequential updates is something you can't do at the moment, for the rest, rrdtool has no problem doing what you would like ... on the graphite homepage there is quite a lot of dis-information about rrdtool abilities ... unfortunately.