numaproj / numalogic

Collection of operational time series ML models and tools
https://numalogic.numaproj.io/
Apache License 2.0
166 stars 28 forks source link

Feat: Support Anomaly Detection for fields using valuesDoublesSketch. #411

Open shashank10456 opened 1 month ago

shashank10456 commented 1 month ago

Summary

Lets add support for fields that use valuesDoublesSketch in Numalogic. Currently, we dont support this natively. This is a frequently asked/used feature and its better to have default Numalogic support out-of-the-box.

What change needs making? I have created this branch and PR: (https://github.com/numaproj/numalogic/pull/409) which supports latency based anomaly for a particular use case but this needs to be generalized for wider adoption. Major changes include adding configuration/YAML support for postaggregations, aggregations, percentile on top of this PR. These fields should be config driven.

Use Cases

When would you use this? We would use this when ever the input fields use Sketches(https://datasketches.apache.org/) to represent the value. This is used when we represent the "actual values" by "approximate values" trading accuracy for computation.


Message from the maintainers:

If you wish to see this enhancement implemented please add a 👍 reaction to this issue! We often sort issues this way to know what to prioritize.