Langleu / MA_Crawler

GitHub Crawler to find any given document. Built for my master thesis.
1 stars 0 forks source link

second GitHub strategy #4

Open Langleu opened 4 years ago

Langleu commented 4 years ago

based on the web app via webcrawlers

Langleu commented 4 years ago

changed to on hold as further research showed that there is not much sense in using the web app for crawling files. It has the same limitations as the API due to the fact that it is based on and on top of that it produces an overhead of fetching extra resources and only 10 results per page.