nextstrain / forecasts-ncov

SARS-CoV-2 variant growth rates and frequency forecasts
https://nextstrain.org/sars-cov-2/forecasts/
7 stars 2 forks source link

ingest/fetch-ncov-global-case-counts: follow redirection #68

Closed joverlee521 closed 11 months ago

joverlee521 commented 11 months ago

Our case counts updates resulted in an empty file¹, which lead to the failure of our model pipelines.² Turns out the OWID endpoint is redirected to another endpoint.

$ curl -I https://covid.ourworldindata.org/data/owid-covid-data.csv
HTTP/2 302
date: Fri, 27 Oct 2023 17:34:37 GMT
location: https://covid-19.nyc3.digitaloceanspaces.com/public/owid-covid-data.csv
...

curl does not follow HTTP redirections by default, so we have to tell curl to follow redirection with --location option.

¹ https://github.com/nextstrain/forecasts-ncov/actions/runs/6656776373/job/18090077156#step:5:11 ² https://bedfordlab.slack.com/archives/C03BY4MPNCS/p1698393532650979

Checklist