search

m-lab / etl-gardener

Gardener provides services for maintaining and reprocessing mlab data.
Apache License 2.0
13 stars 5 forks source link

Add more queues to switch processing #343

Closed cristinaleonr closed 2 years ago

cristinaleonr commented 2 years ago

The Gardener_ParseTimeDifferenceTooOldOrMissing alert has been firing for the switch data type. On further inspection of the dates where the parse time is too old (> 80 days), it seems they follow a systematic pattern, indicating that switch is falling behind. Adding more queues so switch can catch up.

Also, install certificates to fix build issue in Google Cloud Build: Step #2 - "Build the testing docker container": fatal: unable to access 'https://gopkg.in/m-lab/pipe.v3/': server certificate verification failed. CAfile: /etc/ssl/certs/ca-certificates.crt CRLfile: none And Travis: fatal: unable to access 'https://gopkg.in/yaml.v2/': server certificate verification failed. CAfile: /etc/ssl/certs/ca-certificates.crt CRLfile: none More on this issue https://www.zoocha.com/news/fixing-issues-multiple-servers-caused-recently-expired-root-certificate. Same issue was fixed in the locate repo.

This change is Reviewable

coveralls commented 2 years ago

Coverage Status

Coverage decreased (-0.1%) to 60.427% when pulling b1bab62f324699d0e51560a271aee4388f85c13d on sandbox-cristinaleon-switch-num-queues into d4bda5bfc75d23280cdc6978d648fd229223154a on master.