KStocky / ShaderTestFramework

An automation testing framework for testing shader code
MIT License
20 stars 1 forks source link

Stat tracking using telemetry #103

Open KStocky opened 3 weeks ago

KStocky commented 3 weeks ago

Is your feature request related to a problem? Please describe.

I have a task #72 for gathering statistics of test runs. It would be good to extend that future functionality with telemetry tracking. So after every run on GitHub actions we send off all the statistics collected to somewhere where we can track the statistics over time and commits etc.

Describe the solution you'd like It would seem like using OpenTelemetry in combination with Azure Data Explorer is a good place to get started. So we take all the statistics that we gather throughout a test, then use OpenTelemtry to export it out to Azure data explorer. From there we could have a number of dashboards to view the statistics over time

Describe alternatives you've considered I have heard of Graphana as another way of collecting telemetry. It could be another option

Additional context OpenTelemetry exporter docs ADE ingestion docs

KStocky commented 6 days ago

I do not intend on persuing this much further. It would likely be a large amount of work that I don't particularly want to do right now... Maybe in the future