Agenda 2024-02-27

[jgraham]

• Goals and roadmap
• Firefox_android broken (looks like crash reporter problems).

[jcscottiii]

Goals and roadmap:

• Jgraham: I have updated the PR to incorporate all the feedback. Please review
• Panos: Within the next two meetings, we should score the progress

Firefox_android broken:

• Jgraham: Will do some investigation and talk to the appropriate parties
• panos: Our team uses this url - https://ecosystem-infra-rotation.appspot.com/ Would this help?
• Jgraham: Yes
• Panos: Will take an action item to expand to mobile.
• Jgraham: How much do we care about WebKitGTK mini browser?
• Sam: It's okay to remove it if needed.
• Jgraham: We need to also analyze how to flag. For example if WebKitGTK is only flagging, it might be okay

Any other notes:

• Panos: Any progress on the iOS testing?

• Sam: No. Currently staff is working on moving safari runs away from azure pipelines.

• Panos: On another topic: the Azure folks increased our quota. From 20-30 for the next 6 months. They recommend we move to GitHub actions for a long term solution.

• Sam: Everything I have been looking at has been doing full runs. Nothing around running PRs in GitHub actions

• Jgraham: Any comparison around what they will offer for us on Github Action

• Panos: Not sure on what they are offering on the GitHub action.

• Sam: On GH actions, Windows and Mac OS are charged with multipliers per minute/per run.

• Panos: So it could be potentially more expensive?

• Sam: Yes.

• Jgraham: It depends on the capacity they offer us. If they only give us one Windows box, it will be very hard for us.

• Sam: https://docs.github.com/en/billing/managing-billing-for-github-actions/about-billing-for-github-actions#included-storage-and-minutes

• Sam: We only would get 200 minutes a month for Mac OS

• Jgraham: We would easily hit that for one run.

• Panos: We need someone from Azure pipelines. And need to talk soon since they probably want us to move by the summer.

• Sam: If we only look at the jobs running PRs on Azure, there's Safari and Edge runs. Making sure tooling works.

• Jgraham: I think we do Chrome on Windows

• Sam: That's only part of the infrastructure tests. If we move all the Mac OS full runs off of Azure pipelines, we would really only have the Edge runs.

• Panos: Will start a thread.

[jgraham]

• Goals and roadmap
  • Merged proposed changs
  • Action item: @gsnedders to review before final PR merge.
  • Next time try to score where we are in Q1.
• Firefox_android broken (looks like crash reporter problems).
  • jgraham will try to get this fixed
  • https://ecosystem-infra-rotation.appspot.com/ has desktop run status, we could expand that for mobile.
  • Does everything on epochs/daily have the same support level?
  • Maybe not webkitgtk minibrowser
  • iOS progress?
  • [gsnedders] - Most of the current stuff is focused on moving Safari runs away from Azure pipelines.
  • [panos] - That's a precursor to running Safari/wktestrunner on Apple infra?
  • [gsnedders] - Yes. I hope that iOS won't be too much followup work.
  • Azure
  • [panos] Quota has been increased 20→30, and they suggest moving to GH actions.
  • [gsnedders] For stuff running on PRs, we expect to keep using Azure pipelines.
  • [jgraham] - Are we supposed to use the normal free tier of GH actions; what would the capacity be?
  • [panos] - Not sure, I can get back to them and get more details.
  • [gsnedders] - Windows and macOS are charged differently on GH actions. But I don't remember the detail.
  • [jgraham] - We still need similar capacity.
  • [panos] - Not clear what kind of macOS you get in GH actions.
  • [gsnedders] - Free tier is 200 minutes / day. We need more than that.
  • [panos] - We need to figure out what a move to GH actions would mean, assuming a summer timeline.
  • [gsnedders] - If we look at just the PR jobs, what is there? Safari and Edge runs and then a bunch of PR jobs.
  • [jgraham] Chrome on Windows but I don't remember what exactly.
  • [gsnedders] - Edge on Windows will be majority of load, then PR runs.
  • [panos] - I'll start an email thread to discuss this.