UI loads slowly because of missing Grafana plugins

What went wrong?

What happened:

The loading of Grafana Oncall UI pages is very slow sometimes. Whenever this happens, we see this inside the Grafana container logs:

logger=context userId=2 orgId=1 uname=sa-1-extsvc-grafana-oncall-app t=2024-10-11T12:00:07.08191973Z level=info msg="Request Completed" method=GET path=/api/plugins/grafana-incident-app/settings status=404 remote_addr=172.24.56.37 time_ms=19 duration=19.349859ms size=64 referer= handler=/api/plugins/:pluginId/settings status_source=server
logger=plugin.grafana-oncall-app t=2024-10-11T12:00:10.094512942Z level=error msg="getting incident plugin settings" error="request did not return 200: 404"
logger=context userId=2 orgId=1 uname=sa-1-extsvc-grafana-oncall-app t=2024-10-11T12:00:13.561009702Z level=info msg="Request Completed" method=GET path=/api/plugins/grafana-labels-app/settings status=404 remote_addr=172.24.56.37 time_ms=11 duration=11.395239ms size=64 referer= handler=/api/plugins/:pluginId/settings status_source=server
logger=plugin.grafana-oncall-app t=2024-10-11T12:00:15.697360195Z level=error msg="getting labels plugin settings" error="request did not return 200: 404"

It doesn't seem to happen on every page load, but often enough to be annoying.

What did you expect to happen:

Smooth loading of the web UI :)

How do we reproduce it?

Install Oncall and Grafana using the official Helm chart
Open Grafana and navigate around the Oncall plugin pages.

Grafana OnCall Version

v1.10.3

Product Area

Alert Flow & Configuration

Grafana OnCall Platform?

Kubernetes

User's Browser?

Firefox 131.0.2 (64-Bit)

Anything else to add?

It is my understanding that the plugins grafana-incident-app and grafana-labels-app only exist in Grafana Cloud, so these plugins missing should be expected for OSS installations. The 404 responses by itself are not a big issue, but the resulting slow UI is an issue. I've made sure that our servers return the 404 status code immediately, so there is probably some kind of retry in the client code that makes things slow.

grafana / oncall