euagendas / m3inference

A deep learning system for demographic inference (gender, age, and individual/person) that was trained on massive Twitter dataset using profile images, screen names, names, and biographies
http://www.euagendas.org
GNU Affero General Public License v3.0
145 stars 57 forks source link

Add streaming option to infer #22

Open davidjurgens opened 3 years ago

davidjurgens commented 3 years ago

For inferring a large number of users, it would be fantastic if infer would have an option to stream the results to a file as it finishes, rather than returning the values. This behavior is particularly helpful for big inference jobs that need a few hours (days?) to finish and where intermediate results would be useful.