opensafely-core / job-server

A server for mediating jobs that can be run in an OpenSAFELY secure environment. q.v. job-runner
https://jobs.opensafely.org
Other
5 stars 11 forks source link

<str:project_slug>/ is slow for some projects #3393

Open madwort opened 1 year ago

madwort commented 1 year ago

Spotted on bubble-up: the page for <str:project_slug>/ is slow, but seemingly only with a few specific orgs - worst offender is /investigating-events-following-sars-cov-2-infection/ , with opensafely-internal runner-up.

See also https://ui.honeycomb.io/bennett-institute-for-applied-data-science/environments/production/datasets/job-server/result/w6YcsXamFaW?bubbleup_result=t42SFETUwhr&tab=bubbleup

slow URL: https://jobs.opensafely.org/investigating-events-following-sars-cov-2-infection/

ghickman commented 1 year ago

The optimisation in #3400 doesn't seem to have made a noticeable difference.

@madwort has added some spans in #3401 to see if we can pick apart different parts of the view.

madwort commented 1 year ago

the repos span is the bulk of the request time, e.g. https://ui.honeycomb.io/bennett-institute-for-applied-data-science/environments/production/datasets/job-server/result/C1gNycu3F7t/trace/CUcWLoT8mts?fields[]=c_name&fields[]=c_service.name&span=ec7c10c24d66c474

Screenshot 2023-08-15 at 15 02 58
mikerkelly commented 1 month ago

4634 noted this issue and suggest a solution.