rust-lang / rustc-perf

Website for graphing performance of rustc
https://perf.rust-lang.org
627 stars 148 forks source link

Show changes over time to compiler performance in the triage report #1044

Open rylev opened 3 years ago

rylev commented 3 years ago

The triage report has improved, but its focus is largely on highlighting single changes impacts on the performance of the Rust compiler. We should think more holistically about what we want to get from the triage report.

Specfically we should add more detail about change over time. For instance, we can show change over the last 1 week/over the period in the triage report, 1 month, 6 months, 1 year, etc.

To do this we can:

Mark-Simulacrum commented 3 years ago

One small step may be to auto-generate a partial summary (to be edited by the triage report author, perhaps) that gives an indication of performance over that week. I often end up writing something sort of hinting at that, but typically without any hard numbers.

I also think it's worthwhile to ask why we care about change over time / what the purpose of these longer term summaries would be. I think some possible goals might be (with slightly different audiences and "purposes" in mind):

IMO, it could be a good idea to either file a separate ticket or just change the purpose of this one to answering this question -- it feels a little like the specific "change over time" is a goal without rationale just yet, and perhaps taking a step back to look at what our goals (as the compiler performance group, for example) are, so that we can then design solutions to fit them. (Ideally with a finer grain than "faster rustc").