Additional scrapers to add

rseng / rse

tools for assessment and categorization of research software

https://rseng.github.io/rse/

Mozilla Public License 2.0

16 stars 2 forks source link

Additional scrapers to add #66

Open vsoch opened 2 years ago

vsoch commented 2 years ago

[x] ascl https://ascl.net/code/all/limit/250
[ ] biogrids https://biogrids.org/software/
[ ] https://geodynamics.org/software?
[ ] and the rest (non data, but software) from https://scicodes.net/participants/

NickleDave commented 2 years ago

Should there be a cran scaper?
https://cran.r-project.org I did a search in rse but didn't find it, and packages from there end up in custom currently.
A google search did not return any python wrappers for the cran API

vsoch commented 2 years ago

Scrapers are typically just for version control resources, so if the code is in some version control we can scrape it. And if there is no cran API then I'm afraid we are out of luck!

If you are looking for package manager scrapers, see CiteLang, just published today :) https://github.com/vsoch/citelang

NickleDave commented 2 years ago

Ah right I forgot that rse "uses ... (version control systems) as sources of truth".

Thanks for telling me about CiteLang though!

NickleDave commented 2 years ago

saw this and thought it was relevant and that there were a couple other VCSs / apps that wrap version control here that might be worth thinking about:
https://harihareswara.net/posts/2022/what-you-miss-by-only-checking-github/