search

catapult-project / catapult

Deprecated Catapult GitHub. Please instead use http://crbug.com "Speed>Benchmarks" component for bugs and https://chromium.googlesource.com/catapult for downloading and editing source code..
https://chromium.googlesource.com/catapult
BSD 3-Clause "New" or "Revised" License
1.93k stars 563 forks source link

Accessing the data without the GUI #2839

Open natorion opened 8 years ago

natorion commented 8 years ago

The V8 team was recently discussing with the Speed Infra folks that it would be great to access the data on Chromeperf without using the GUI. Essentially we would like to access the data for a benchmark like v8.x64.Octane via a REST call and receive the data in a JSON. I suspect it is enough to provide the annotations for each data point (like git range) on demand.

This would enable the V8 team to use other, additional visualizations or do data mining.

@anniesullie @eakuefner @camillobruni

anniesullie commented 8 years ago

Is the CSV API enough for this? Normally you should be able to see how to access the CSV by:

  1. Open up a chart
  2. Click the (i) next to a timeseries in the legend
  3. Click "Download as CSV"

Apologies that things are pretty busted currently; we're in the process of debugging some problems so both the v8 charts and the tooltips aren't working at the moment.

Here is an example timeseries: https://chromeperf.appspot.com/graph_csv?test_path=ChromiumPerf/chromium-rel-mac-retina/sunspider/Total

natorion commented 8 years ago

CSV would also be ok although we would want to automate this process and I don't want to use WebDriver to do this automation :-)

natorion commented 8 years ago

Ah, ignore my last comment. The link already works. Is there anything to consider on how to access benchmarks which are not public?

anniesullie commented 8 years ago

Ah, that's a bit tougher. We have a proposal for implementing API keys in #1359 that would make this a lot easier. Currently we use whitelisted IPs to allow script access to internal data.