Add actions in MissingDataComplementor to complete data without getting complete info about authors.
The actions should be:
fill_followers_ids
fill_friends_ids
in crawl_users_by_author (used by _fill_data_for_author_connection_type for example) we need an option to just get followers / friends ids, without the complete user data, since the requests could take a lot of time. We need to remove the line in:
tomgond
commented
5 years ago
Add actions in MissingDataComplementor to complete data without getting complete info about authors.
The actions should be: fill_followers_ids fill_friends_ids
in crawl_users_by_author (used by _fill_data_for_author_connection_type for example) we need an option to just get followers / friends ids, without the complete user data, since the requests could take a lot of time. We need to remove the line in:
https://github.com/aviade5/measurement-of-online-discussion-authenticity/blob/f30b77dc91a7eebebe70f7b1815773fb9a5bf8a7/bad_actors/social_network_crawler/social_network_crawler.py#L115
And be able to insert data to the DB. We need to create guid out of the author id received from twitter API.
Similar function can be found here and also be used: https://github.com/aviade5/measurement-of-online-discussion-authenticity/blob/f30b77dc91a7eebebe70f7b1815773fb9a5bf8a7/bad_actors/social_network_crawler/social_network_crawler.py#L78