mediacloud / metadata-lib

How Media Cloud approaches extracting metadata from online news stories
Apache License 2.0
12 stars 5 forks source link

improve CI test run reliabiility by using cached fixtures? #69

Closed rahulbot closed 11 months ago

rahulbot commented 1 year ago

The CI fails intermittently due to HTTP errors because we are pulling live web data. I see the docs suggest running scripts/get-test-web-content.py to build a local cache that tests can use. Should add add this to the test.yml before the test run to try and have then run more reliably? Or commit cached copies?