euagendas / m3inference

A deep learning system for demographic inference (gender, age, and individual/person) that was trained on massive Twitter dataset using profile images, screen names, names, and biographies
http://www.euagendas.org
GNU Affero General Public License v3.0
146 stars 56 forks source link

Use Twitter API #6

Closed computermacgyver closed 4 years ago

computermacgyver commented 4 years ago

We previously just parsed the HTML of profile pages to get the needed information when given a Twitter username or id. That method is no longer working (Twitter doesn't serve the needed information).

This PR now uses the Twitter API. This is annoying in that anyone using the library in this way will need to create a Twitter app, abut it is not going to break (as easily) in the future.

I've tested but would value a second pair of eyes.

zijwang commented 4 years ago

I refactored the code a bit, edited the readme, and added support for package building.

computermacgyver commented 4 years ago

Great work. The refactoring makes sense, and thanks for catching the missing dependency!