mozilla-services / merino-py

Web Service for Firefox Suggest
Mozilla Public License 2.0
9 stars 9 forks source link

[DISCO-3010] Calibrate smoke and average tests for n2-highcpu-8 machine change and real-world network traffic data [load test: warn] #653

Closed Trinaa closed 1 month ago

Trinaa commented 1 month ago

References

JIRA: DISCO-3010

Description

For the latest load test results, please see the Merino Load Test Spreadsheet

Calibrating for n2-highcpu-8 machine change

In the end, no additional load was necessary, since scaling is still achieved with the configured load

image

Adjusting traffic distribution

The current load distribution between endpoints has proven to be slightly different than the original 50/50 estimate. So adjustments have been made as follows:

49.7% --> 64.2% weatherSuggestions 42.1% --> 29.8% curatedRecommendationsLocale 7.4% --> 5.2% curatedRecommendationsRandomTopics 0.2% --> 0.2% admSuggestions 0.2% --> 0.2% dynamicWikipediaSuggestions 0.2% --> 0.2% fakerSuggestions 0.2% --> 0.2% topPicksSuggestions

image

PR Review Checklist

Put an x in the boxes that apply

Trinaa commented 1 month ago

@katerinachinnappan or @mmiermans I'd appreciate your eyes on the new distribution, just to make sure I'm correlating the Grafana data correctly.