Closed jmaassen closed 7 months ago
In further testing I still see a database error pop up whenever this scraper runs:
ERROR: duplicate key value violates unique constraint "mention_external_id_source_key"
I converted the PR to draft and will investigate further.
Kudos, no new issues were introduced!
0 New issues
0 Security Hotspots
No data about Coverage
0.0% Duplication on New Code
Failed conditions
4.3% Duplication on New Code (required ≤ 3%)
C Reliability Rating on New Code (required ≥ A)
See analysis details on SonarCloud
Catch issues before they fail your Quality Gate with our IDE extension
SonarLint
Mention scraper fixed
Fixes #1085 #1084
Changes proposed in this pull request:
How to test:
docker compose down --volumes
docker compose build
docker compose up --scale data-generation=0 --scale scrapers=1
10.1021/ja026939x
as reference paperdocker compose exec scrapers /opt/java/openjdk/bin/java -cp /usr/myjava/scrapers.jar nl.esciencecenter.rsd.scraper.doi.MainCitations
manually. This takes about a minute...PR Checklist:
docker-compose.yml