m-lab / etl

M-Lab ingestion pipeline
Apache License 2.0
22 stars 7 forks source link

Increase v2 / decrease v1 resources #1070

Closed stephen-soltesz closed 2 years ago

stephen-soltesz commented 2 years ago

The introduction of the tcpinfo v2 parser has significantly slowed processing of the v2 pipeline. This change increases the replicas from 4 to 6.

This change also reduces the max number of batch pipeline instances from 80 to 40 and decreases the task queue rates by at least 50%. Typically, we would reduce v1 gardener throughput by updating the "NUM_QUEUES" setting in the k8s config for those deployments, but we no longer deploy the v1 gardener system. By reducing the queue rates, we should accomplish the equivalent result. (but v1 gardener was notoriously difficult to performance tune).


This change is Reviewable

coveralls commented 2 years ago

Pull Request Test Coverage Report for Build 7268


Totals Coverage Status
Change from base Build 7262: 0.0%
Covered Lines: 3972
Relevant Lines: 6084

💛 - Coveralls
stephen-soltesz commented 2 years ago

This is un-deployable to the v1 pipeline anymore...