search

twintproject / twint

An advanced Twitter scraping & OSINT tool written in Python that doesn't use Twitter's API, allowing you to scrape a user's followers, following, Tweets and more while evading most API limitations.
MIT License
15.64k stars 2.72k forks source link

[QUESTION] Output list while running followers scraping #714

Open Bigrev opened 4 years ago

Bigrev commented 4 years ago

Command Ran

def get_followers (username):
    c = twint.Config()
    c.Username = username
    c.Store_object = True
    c.Limit = 40
    twint.run.Followers(c)
    return twint.output.follows_list
print(get_followers("someuser"))

Description of Issue

Hi! in this case, twint returns a list of 40 followers and then stops. I need to return a list of 40 followers (each time) while the scraper is running, i.e: if the user has 400 followers, it should return a list 10 times, is there a way to achieve this without storing the data in a csv, db, etc? thanks!

Environment Details

MAC OS 10.5.3

pielco11 commented 4 years ago

This feature is not available, you should edit a great portion of the source code