Time to at least start thinking in detail about this.
1. View any results page
2. Check, uncheck, fold, unfold, etc. at will
3. Select a specific measurement value or its associated box plot
4. See option "View History"
5. Be sent to a (permalink) page showing the results for that precise set of
measurements graphed over time (for now, the X axis is just the timestamp of
the run).
The hardest part may be dealing the various weirdnesses that stem from the
benchmark having been run with differing parameters over time. This is
inevitable due to JDK upgrades and such. We should brainstorm about these
implications.
Advanced:
- Download JSON for *this* set of information (seems like this should be an
option on every kind of result page we have)
- Create a named historical report, which you can then add any number of graphs
like the above to, to see them overlaid
- Some way that, when running, the user can specify a value like a changelist
number which should then be used as the basis for time comparisons instead
- Option to show all 5 quartiles in the line graph
- A way to see a concise view of all the named reports I've created in one place
- Perhaps with some way to highlight those in the list that contain
"suspicious" discontinuities
Original issue reported on code.google.com by kevinb@google.com on 28 Nov 2012 at 3:40
Original issue reported on code.google.com by
kevinb@google.comon 28 Nov 2012 at 3:40