etsy / oculus

The metric correlation component of Etsy's Kale system
http://codeascraft.com/2013/06/11/introducing-kale/
Other
707 stars 72 forks source link

Consider using Symbolic Aggregate Approximation for indexing time-series data #14

Open stefan-pdx opened 10 years ago

stefan-pdx commented 10 years ago

First off, awesome project! As the documentation mentions, using DTW is computationally expensive. Would the project benefit from using other timeseries indexing methodologies such as Symbolic Aggregate Approximation? In this case, you can transform and discretize time-series data to string representations and perform string-based indexed search.

Let me know what your thoughts are. I'd be happy to submit a PR to implement this.

Cheers!

jonlives commented 10 years ago

@slnovak I'm always happy to consider new algorithms - I'm not particularly familiar with that specific one, but if you were to create a PR that added it alongside the existing algorithms as an option I'd be happy to take a look at it :)

If this algorithm would require additional / differently formatted data being stored in ES please give me a heads up so we can talk about it in a little more detail :)