1078 clear package manager scraper errors

ewan-escience commented 8 months ago

Clear package manager scraper errors on success

Changes proposed in this pull request:

How to test:

docker compose down --volumes && docker compose build --parallel && docker compose up --scale data-generation=0
Create a software page with a package manager pointing to e.g. https://pypi.org/project/ESMValTool/
Run the package manager scraper (docker compose exec scrapers java -cp /usr/myjava/scrapers.jar nl.esciencecenter.rsd.scraper.package_manager.MainPackageManager), this should work without errors in the logs or in the "Background services" tab
Manually set an error: UPDATE package_manager SET reverse_dependency_count_last_error = 'Test error';
Check for the error on the "Background services" tab
Clear the scraped_at field so you don't have to wait an hour before scraping again: UPDATE package_manager SET reverse_dependency_count_scraped_at = NULL;
Run the scraper again, the error should disappear from the tab.
Create another package manager scraper with a non-existing link, like https://pypi.org/project/idonotexist/
Run the scraper again, there should be an error in the logs.
Filter the error logs on the slug of the software page, it should still be there