ARM-software / workload-automation

A framework for automating workload execution and measurement collection on ARM devices.
Apache License 2.0
152 stars 120 forks source link

Add JetNews to the available workloads #1240

Closed luis-machado-arm closed 4 months ago

luis-machado-arm commented 1 year ago

These three commits add the JetNews workload to the main branch of wa. The first two commits were contributed by Jakub Szostakowski. The third commit is where I picked things up to start making it useful for our team's needs. And also to keep these workloads in a central repo/branch so they don't get scattered around multiple teams/repos.

luis-machado-arm commented 1 year ago

Addressed the comments in this updated PR. I plan to submit the documentation bits separately. Honestly, I don't think the workloads is yet at a stage where we can just use it. It needs a bit more work.

luis-machado-arm commented 1 year ago

ping?

marcbonnici commented 12 months ago

Addressed the comments in this updated PR

Thanks for fixing these, it looks like the changes are heading in the right direction.

So I might have a few questions here and there, as I get familiar with this code.

No problem please reach out if you have any questions and I can try to answer or point you to the relevant parts of the documentation that might help.

Honestly, I don't think the workloads is yet at a stage where we can just use it. It needs a bit more work.

Makes sense, on my side I was able to execute the workload and it launched the Jetnews application, however it doesn't currently seem to perform any tests. There are also no test metrics collected from the workload that would allow for comparison between runs. Are these the sort of extra work that you have planned for this workload?

luis-machado-arm commented 11 months ago

Honestly, I don't think the workloads is yet at a stage where we can just use it. It needs a bit more work.

Makes sense, on my side I was able to execute the workload and it launched the Jetnews application, however it doesn't currently seem to perform any tests. There are also no test metrics collected from the workload that would allow for comparison between runs. Are these the sort of extra work that you have planned for this workload?

Yes, exactly. This initial contribution is a base from which we should (hopefully) build something more meaningful. So things like improved/more meaningful tests, collecting metrics etc, will come later. I don't think we want dependencies on perfetto, so I still need to check how that is going to work in terms of data collection. We'll probably do ftrace, but we need the jank information.

Right now there are 3 very basic tests that scroll things, and you can select those and pass the number of iterations. Even those tests don't seem to work 100% at the moment.

marcbonnici commented 11 months ago

Ok cool thanks for confirming. In which case happy to leave this here as a base that can be used for further development.

luis-machado-arm commented 4 months ago

I have a different patch to enable this.