974 improve maven scraper

[ewan-escience]

More package manager scrapers

Changes proposed in this pull request:

• Add package manager scrapers for Sonatype, Go and Crates.io.
• Fix small bug where 0 is reported when null is returned from the database for package managers
• Improve package manager examples to data generation
• Move scrapers to dedicated package

How to test:

• docker compose down --volumes && docker compose build --parallel && docker compose up --scale data-generation=0
• Create a software page with the following package managers:
  • https://central.sonatype.com/artifact/org.openscience.cdk/cdk-bundle/
  • https://crates.io/crates/tokio
  • https://pkg.go.dev/github.com/gin-gonic/gin
  • https://pkg.go.dev/google.golang.org/grpc
• Run the scraper: docker compose exec scrapers java -cp /usr/myjava/scrapers.jar nl.esciencecenter.rsd.scraper.package_manager.MainPackageManager
• Check the results on the Package manager tab and the Background services tab
• Login as admin and check the error logs, they should have no related errors
• Also add https://pkg.go.dev/google.golang.org/does/not/exist and run the scaper again; the Package manager should report no info instead of 0

Closes #974 Related to #1081

PR Checklist:

• [x] Increase version numbers in docker-compose.yml
• [x] Link to a GitHub issue
• [ ] Update documentation
• [x] Tests

[sonarcloud[bot]]

Quality Gate failed for 'scrapers'

Failed conditions
13.0% Duplication on New Code (required ≤ 3%)

See analysis details on SonarCloud

[sonarcloud[bot]]

Quality Gate passed for 'rsd-frontend'

Issues
0 New issues

Measures
0 Security Hotspots
0.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud

[jmaassen]

Small question: looking at the code, it seems the frontend needs to know which scrapers there are and what data they produce. It has a has coded list of scrapers and fields like dependents and/or downloads. Wouldn't it be easier in the long run if this solution was more modular and allowed the backend to simply provide a list to the frontend of scraper configs?

[ewan-escience]

We could co that, but it would require us to setup some server with this info. If it becomes a problem later, we can have another look.