nelsonic / github-scraper

🕷 🕸 crawl GitHub web pages for insights we can't GET from the API ... 💡
434 stars 96 forks source link

url overwritten by website in profile scraper! #51

Closed nelsonic closed 9 years ago

nelsonic commented 9 years ago

We should be assigning the person's website to the website key instead its overwriting the url ...

e.g:

null { entries: [],
  url: 'http://www.twitter.com/iteles',
  followercount: 45,
  starred: 89,
  followingcount: 33,
  worksfor: 'dwyl.io',
  location: 'London, UK',
  fullname: 'Ines Teles',
  email: '',
  joined: '2013-04-17T21:10:06Z',
  avatar: 'https://avatars1.githubusercontent.com/u/4185328?v=3&s=460',
  contribs: 830,
  longest: 159,
  current: 159,
  lastupdated: 1438969056715,
  orgs:
   [ '/ladieswhocode https://avatars1.githubusercontent.com/u/1634620?v=3&s=84',
     '/bowlingjs https://avatars3.githubusercontent.com/u/8825909?v=3&s=84',
     '/foundersandcoders https://avatars3.githubusercontent.com/u/9970257?v=3&s=84',
     '/docdis https://avatars0.githubusercontent.com/u/10836426?v=3&s=84',
     '/dwyl https://avatars2.githubusercontent.com/u/11708465?v=3&s=84' ] }

where url should be: https://github.com/iteles