m-lab / etl

M-Lab ingestion pipeline
Apache License 2.0
22 stars 7 forks source link

Normalize labels on common parser metrics #455

Open stephen-soltesz opened 6 years ago

stephen-soltesz commented 6 years ago

One day, a single parser service will handle tasks for multiple data types. When that occurs, we want to be able to create a dashboard that distinguishes the behavior for each data type.

This began by adding new "table" labels to several common metrics: https://github.com/m-lab/etl/pull/415

Then generalizing the usage of FileSizeHistogram and RowSizeHistogram to apply to all parsers. https://github.com/m-lab/etl/pull/443 https://github.com/m-lab/etl/pull/448 https://github.com/m-lab/etl/pull/450

There are a few metrics remaining that should be distinguishable.

This work also supports efforts to unify the parser dashboards for monitoring.

stephen-soltesz commented 6 years ago