Store data that helps measure treshhold limits - Githubissues

mozilla-releng / pending_queue_monitor

Monitors the pending tasks queue on different machines for Taskcluster Infrastructure.

Mozilla Public License 2.0

1 stars 3 forks source link

Store data that helps measure treshhold limits #6

Open zsoltfay opened 5 years ago

zsoltfay commented 5 years ago

For this tools to provide effective diagnostics we will need to have data about:

how many workers we have for each worker pool
if every worker's healthy, how many jobs can a worker pool take before its pending count changes from 0
the number of pushes that happen daily or in a specific period of time

Analyzing this data against each other will provide the information we need to answer the following questions:

what is the threshold we can handle for pending
is it expected to have a certain number of pending after comparing the amount of workers against the number of pushes at a given moment
how long will it take for the pending queue to go down

A good place to check for the number of pushes is : https://sql.telemetry.mozilla.org/dashboard/firefox-ci

zsoltfay commented 5 years ago

When taking the number of pushes into account we should start with the following ones: autoland, central, beta and try (also inbound until it dies). Worth noting release and esr will affect level 3 workerType pools and take priority over other repos.