DisasterMasters / TweetAnalysis

Repository for storing the code used to analyse the tweets collected from the Twitter scraper
2 stars 3 forks source link

Add the IDs that follow a user and the IDs the user follows to each User in the Mongo DB #10

Open mickidymick opened 5 years ago

mickidymick commented 5 years ago

Found the appropriate function in the Tweepy API to follow through with the task. Still not sure if we want both the IDs a user follows and the IDs that follow a user of not.

mickidymick commented 5 years ago

After talking with Dr Mokus, Julian, and Nick it was decided to add both the followers and following fields to each user. Starting with the labeled users. I will be adding the code to get these extra fields in the allready existing programs that use the rest and streaming api as well as a stand alone program that will look at a single collection and using the rest api will add the fields to already existing users.

mickidymick commented 5 years ago

The first field added is follower_ids (all the users that follow this user) and following_ids (all the users that this user is following)

audrism commented 5 years ago

Use tmux

use your own window or session so that you don't confuse each other

tmux a ctrl-b <number}

TheHashTableSlasher commented 5 years ago

http://man.openbsd.org/OpenBSD-current/man1/tmux.1 http://atkinsam.com/documents/tmux.pdf https://tmuxcheatsheet.com/ http://dayid.org/comp/tm.html

Helpful links

jball1997 commented 5 years ago

We've written code to grab followers and users they follow and made a "User_Network" collection to put them into.

mickidymick commented 5 years ago

Decided to only grab the user network "following and followers" from users in Users_Labeled that have less than 5000 people following them. This is a little under 9000 users and will take around 2 weeks. The collection that is created is User_Network and each user will include the user ID, a list of user ID's that consist of users following the specified user, and a list of user ID's that consist of users that the specified user follows.