pytorch / test-infra

This repository hosts code that supports the testing infrastructure for the PyTorch organization. For example, this repo hosts the logic to track disabled tests and slow tests, as well as our continuation integration jobs HUD/dashboard.
https://hud.pytorch.org/
Other
82 stars 77 forks source link

[Dr. CI] Record click usage on Dr. CI links #530

Open huydhn opened 2 years ago

huydhn commented 2 years ago

Pitch

Some common questions we have for ourselves from time to time are how useful is the information on Dr. CI page and how best to present it to developers. They're hard questions that don't have fixed answers. As we want to continue to invest in Dr. CI as a developer-facing tool rather than an internal tool used only by DevX, we need to actively measure how effective/useful our message in Dr. CI is to developers. The idea here is to record the clickstream of links on Dr. CI message and use that as the measurement. We probably want to record the following information:

Solution

I think we could setup a redirection on HUD and records these information

cc @ZainRizvi @zengk95 @pytorch/pytorch-dev-infra

ZainRizvi commented 2 years ago

@zengk95 also been working on a login system for HUD. If a user is logged in, then that could let us get even more granular on our usage metrics (like learning "Oh, only Dev Infra folks use the HUD")