We just had a multi-day outage where the crawler didn't make progress because the config file github_repos.jsonhad a malformed entry. To prevent this, write a small script that checks the validity of this file (returning non-zero status if it’s broken), and run it as a GitHub action. Then, the file gets validated as soon as anyone sends a GitHub pull request.
We just had a multi-day outage where the crawler didn't make progress because the config file
github_repos.json
had a malformed entry. To prevent this, write a small script that checks the validity of this file (returning non-zero status if it’s broken), and run it as a GitHub action. Then, the file gets validated as soon as anyone sends a GitHub pull request.