perftool-incubator / CommonDataModel

Templates, scripts, and documentation on using a common data format for metrics, benchmark, and environment data
GNU General Public License v3.0
1 stars 3 forks source link

CommonDataModel

A reference data model that uses elasticsearch to unify data for monitoring and benchmarking

Introduction

What's The Problem?

Our Data is the problem. When it comes to performance benchmarking, or just monitoring performance, we have a data compatibility problem. We don't have a good standard to describe our environment and include performance characterization together. When we don't have this, many of the solutions created to help us visualize, investigate, and identify performance issues are incompatible with each other. Solutions are often designed with very specific environments and cannot be reused for other environments.

How Can We Fix This?

We can define a common way to store information about our environment, our performance tests (if any), and metrics and events we collect. Having a common way to process this information allows us to query, summarize, and visualize performance data across many situations, from comparing compiler performance to identifying bottlenecks in large cloud deployments.

What This Project Will Include

We want to provide enough information so that anyone can start storing and querying this data in a common way. We aim to provide the following: