nelsonic / github-scraper

🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡
434 stars 96 forks source link

Should we collect info on the trending repos/developers from github? #32

Closed iteles closed 9 years ago

iteles commented 9 years ago

It seems like Github is doing a decent(ish) job of putting together trending repos and people so it would be a shame to waste this data: https://github.com/trending

github-trending-repos github-trending-developers

This post explains how the trending data comes together: https://github.com/blog/1585-explore-what-is-trending-on-github#questions

nelsonic commented 9 years ago

@iteles yes, the trends are interesting, but they are curated, limited to a handful of people/projects and not queryable ... we still need to source our own data so that we can show people _relevance_.

iteles commented 9 years ago

I Absolutely agree. Using the raw data people can put together the information in a way that's much more interesting for them. I was considering it more as an intriguing source of data in that the trajectory of projects and people tagged as once appearing on the trending list might be of interest.
I'd also originally considered it as a hook for Hansel but we would actually want him to be more self-reliant than that! :+1:

nelsonic commented 9 years ago

It certainly is interesting data. Much like this list: http://www.wwe.com/classics/classic-lists/top-50-good-guys :wink: