Use MessagePack for serialization

ExpediaGroup / adaptive-alerting

Anomaly detection for streaming time series, featuring automated model selection.

Apache License 2.0

202 stars 49 forks source link

Use MessagePack for serialization #261

Open djsutho opened 5 years ago

djsutho commented 5 years ago

Currently we are using json for data serialization to/from kafka topics.

We should have the option of using MessagePack throughout the system as it has performance benefits and it makes it consistent with the ingest topic which defaults to using MessagePack.

williewheeler commented 5 years ago

We have a Kafka serde for MetricData, but we need serdes for the other data types too (e.g. MappedMetricData, Anomaly). MessagePack requires us to hand-craft these on a per-type basis.

djsutho commented 5 years ago

Actually might just be able to copy the json implementation and use this https://github.com/msgpack/msgpack-java/tree/develop/msgpack-jackson