Build a web scraper - Githubissues

BioinfoNet / Affordabee

https://bioinfonet.github.io/Affordabee/

Creative Commons Zero v1.0 Universal

1 stars 0 forks source link

Build a web scraper #4

Open wanjauk opened 3 years ago

wanjauk commented 3 years ago

The web scraper will be used to get the data from publisher pages and existing APIs automatically. Any resources with information where researchers can publish at a waived or subsidised APC will be useful in providing content to the website. We will be looking to automate this process and make use of GitHub Actions or CI to extract the data and add to the GitHub pages.

kipkurui commented 3 years ago

Owing to the unstructured nature of the information on various publisher's websites, I am not sure if this is possible, but we'll keep exploring. The current solution is to use crowd-sourcing on the website through a G-Form, which feeds to the website directly after review and approval.