m-lab / etl

M-Lab ingestion pipeline
Apache License 2.0
22 stars 7 forks source link

Adjust K8S parsers to use 15 cpus #981

Closed gfr10598 closed 3 years ago

gfr10598 commented 3 years ago

The 2.0 parsers are running on 16 cpu machines, but only using 7 cpus. This allocates 15 cpus, which improves throughput and utilization, but also increases GCS and BQ costs by a very modest amount.


This change is Reviewable

coveralls commented 3 years ago

Pull Request Test Coverage Report for Build 6380


Files with Coverage Reduction New Missed Lines %
active/poller.go 3 67.86%
<!-- Total: 3 -->
Totals Coverage Status
Change from base Build 6376: -0.02%
Covered Lines: 3444
Relevant Lines: 5140

💛 - Coveralls