swsnu / swpp2019-team3

Browse and Organize papers, Share and Expand your ideas (for now, resources for ML and Text Analytics are disabled)
https://www.papersfeed.online
8 stars 2 forks source link

Getting Download or Access URLs of Papers #82

Closed davin111 closed 4 years ago

davin111 commented 4 years ago

Is your feature request related to a problem? Please describe.

We have the url button on PaperSpec.

스크린샷 2019-11-13 13 22 50

However, unless we manually put download or access urls of papers into our DB or the frontend components, it doesn't work for now.

We need more smart ways to get the urls automatically. If possible, direct download-possible urls(example) of the given paper will be better than access one.(Of course all urls should be legal.)

Describe the solution you'd like

Even though I have no idea about it for now, I think we can crawl somehow urls of paper detail pages(example) of other academic websites.

Describe alternatives you've considered

Or as @kosumin mentioned the possibility , we can exploit APIs of other academic websites.

kosumin commented 4 years ago

https://api.clarivate.com/swagger-ui/?url=https%3A%2F%2Fdeveloper.clarivate.com%2Fapis%2Fwos%2Fswagger

kosumin commented 4 years ago

https://github.com/karpathy/arxiv-sanity-preserver/blob/master/download_pdfs.py