search

ssc-oscar / gather

For harvesting latest repos
10 stars 9 forks source link

Added sf and gl scrapers. Both expect db name and collection name as … #2

Closed zol0 closed 5 years ago

zol0 commented 5 years ago

…arguments. Gitlab scraper is currently a clone of Dr. Mockus code from fdac18. Need to look at improving it.

user2589 commented 5 years ago

BTW, I have a package which could simplify this to:

api = GitHubAPI()
for repo in api.all_repos():
    ...

It also supports rotating multiple tokens, GitLab and BitBucket. SourceForge is still yet to implement.