mozilla / missioncontrol

Real-time monitoring of Firefox release health
Mozilla Public License 2.0
21 stars 18 forks source link

The way we fetch data is inefficient #115

Closed wlach closed 6 years ago

wlach commented 7 years ago

The current design on the server is to fetch each individual aggregated measure combination (platform/channel/measure) one-at-a-time. But as @maurodoglio pointed out, this is almost certainly inefficient.

We could fetch all the measures for a specific platform-channel at once (or in batches).

wlach commented 6 years ago

We want to do this before creating a mission control production service, so that we don't double the load on athena. I believe a simple implementation which fetched data for all the measures per platform/channel at one time would be enough to have us query Athena 3x or more less on average.