BTrDB / btrdb-server

Berkeley Tree Database (BTrDB) server
http://btrdb.io
MIT License
909 stars 66 forks source link

BTrDB use case for irregular interval time series #52

Closed georgew5656 closed 6 years ago

georgew5656 commented 6 years ago

We are considering migrating time series data from mongoDB to BTrDB and trying to understand whether the peculiarities of our data will be supported.

The time series data comes on irregular intervals between 30 seconds up to a few minutes. Additionally, each key is mapped to a vector value within each time series.

immesys commented 6 years ago

The irregularity of the data is not a problem. We don't directly support vector data though. A lot of our data is intrinsically a vector but we unwrap it into scalar streams (e.g a vector of 3 numbers becomes 3 distinct streams).

In general I recommend BTrDB when you have very dense streams (e.g >10Hz, up to 1Khz) or when you require very fast aggregate queries within a stream (e.g years of 1khz data and you want to find all places where it crossed a threshold).