1055 - show reference papers and scraped citations

[dmijatovic]

Show reference papers and scraped citations

Closes #1055

Changes proposed in this pull request:

• Reference papers section is added to software page (image 1)
• Scraped citations of reference papers are integrated into mentions section of software page
• Mention count RPC is updated to include scraped citations (total mention count)
• Mention count in software card is updated (using updated mention count RPC)
• Unrelated change: upgraded postgrest to latest version to fix 416 response error when using count=exact

How to test:

• make start to build solution and generate test data
• login as rsd-user and create test software. Or login as rsd-admin and modify existing one.
• Navigate to reference papers section and add following reference papers:
  • doi:10.1186/s13321-017-0220-4
  • 10.1186/1758-2946-6-3
• Navigate to mentions and add few mentions via import and manually
• Confirm reference papers are show
• Confirm all mentions are shown. Note! in order to let scraper run in the background you will need to restart if you are used make start. Use docker compose down and then docker compose up (observe logs for scraper service).
• Confirm mention counts are correct on software page and in the card of software overview page
• Try adding some of scraped mentions manually in the mentions section. This is allowed but only one entry will be shown and counted

Reference papers on software page

Reference papers on edit software page

Mentions on edit software page

Mentions count on software page (consolidated count of mentions and citations)

Mentions count in the software card (and order on mention count)

PR Checklist:

• [ ] Increase version numbers in docker-compose.yml
• [ ] Link to a GitHub issue
• [ ] Update documentation
• [ ] Tests

[sonarcloud[bot]]

[rsd-database] Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
0 Code Smells

No Coverage information
0.0% Duplication

[sonarcloud[bot]]

[rsd-frontend] Kudos, SonarCloud Quality Gate passed!   

0 Bugs
0 Vulnerabilities
0 Security Hotspots
3 Code Smells

43.8% Coverage
0.0% Duplication

[jmaassen]

Tried different tests, and seems to work well. Some comments / thoughts:

I do see some issues with the harvested information. There seems to be quite few (older) publications that do not have a DOI yet. For example:

The thesis' on the bottom of this list don't have a DOI (that is expected). I would expect the journal papers on the top to have one though? As far as I know, many older paper where retroactively assigned a DOI. Also, the top one does not seem to have a link associated with it, while the second one does have a link, but it's broken.

Interestingly, the web page of the reference paper (cpe08) seems to refer to a different Marvin paper (10.1016/j.websem.2009.09.002) which is also found by our scraper. They don't seem to find the DOI-less one though.

Sometimes I also see multiple versions of papers:

And some have issues with international characters:

This is the expected output:

Link to the paper

Overall, I think this is a great feature, but we may run into some data duplication and quality issues ;-)