search

spotify / ffwd

a flexible metric forwarding agent
https://spotify.github.io/ffwd/
Apache License 2.0
79 stars 33 forks source link

Add a new Metric Data Model that can Support Distribution. #214

Closed ao2017 closed 3 years ago

ao2017 commented 4 years ago

Heroic histogram data is currently computed locally.
It is practically impossible to aggregate percentile.
We are adding distribution to heroic to address that issue. Distribution will create data sketch that will be used upstream to compute percentile on the entire data distribution.

This task will add a point value of object type. Please refer to existing implementations for more details:

  1. Json Metric : https://github.com/spotify/ffwd/tree/master/api/src/main/java/com/spotify/ffwd/model
  2. Proto Metric : https://github.com/spotify/ffwd/blob/master/core/src/main/proto/spotify_100.proto
  3. Proto Metric with distribution :https://github.com/spotify/ffwd-client-java/tree/master/ffwd-client/src/main/java/com/spotify/ffwd/v1

DoD : Spotify_100 and Spotify100ProtoSerializer.java serializers should support both the old and new metric formats.