search

petermr / openVirus

aggregation of scholarly publications and extracted knowledge on viruses and epidemics.
The Unlicense
67 stars 17 forks source link

A place to put paper metadata and extractions #33

Closed markmacgillivray closed 2 years ago

markmacgillivray commented 4 years ago

Hi all, how are you all doing? I was not sure where best to contact you, so thought I would create an issue.

I have already started a site where I am searching all the main sources I could think of for new papers about covid-19. I'm then making them available via search, and running entity extraction tools on them. For any sources that have it, I can already get most metadata, abstracts, etc. I can also find an open copy whenever there is one in most cases, and am improving the system as time goes on.

I note in some of your issues you are doing things like figuring out how to scrape DOAJ. Perhaps it would save you some time to collect metadata from my service instead?

Also, once you do have any papers extracted that you want to share somewhere, where are you thinking of doing so? Are you making a site? If not, maybe it would be suitable for you to deposit them to me. You could send metadata and analyses that you perform.

I don't have a lot of time left right now for being directly involved in what you're doing, and I am only focused on finding new papers, not searching through older relevant ones. But maybe there is some crossover where it would be of help. Integrating everything would be too much of a big job for any of us, and also probably not needed - if you have useful things you can run on your own service or on your own machines, all we really need is for you to be able to send your results in a suitable format, which I could specify for you fairly quickly.

Let me know in comments here if any of this sounds useful.

If you want to take a look:

https://covidpapers.com

markmacgillivray commented 4 years ago

Here is an example of a paper with extracted content:

https://covidpapers.com/id/QriwcegAA7hwRsRbM