Minitour / BigDataHW4

MIT License
0 stars 0 forks source link

Create a script in python which fetches top 500 users from social blade. #1

Closed Minitour closed 5 years ago

Minitour commented 5 years ago

SocialBlade does not offer an APIs thus we must "scrape" the page using plain old HTML parsing techniques.

Write a script which makes a GET request to this page

https://socialblade.com/twitter/top/500/followers

Extracts the the users table from it and converts it into either a CSV or JSON format.

The script should be in python and synchronous.

aPaXuC commented 5 years ago

Please add user_id for each user from the list. You can see example here: https://github.com/Minitour/BigDataHW4/blob/master/playground/notebooks/top_users.csv

Minitour commented 5 years ago

@gutmanan Here is the lookup API

https://developer.twitter.com/en/docs/accounts-and-users/follow-search-get-users/api-reference/get-users-lookup.html