search

JustAnotherArchivist / snscrape

A social networking service scraper in Python
GNU General Public License v3.0
4.51k stars 712 forks source link

Any risk of throttling due to continuous usage? #970

Closed plebiolira closed 1 year ago

plebiolira commented 1 year ago

First of all, thanks so much, JustAnotherArchivist, for the excellent work with snscrape.

Now that the Twitter API has stopped offering the stream functionality for good (unless you want to pay $5k/mo for enterprise), I'm working on converting my tweet streaming bot to use snscrape by running it periodically via APScheduler on python.

My question would be if you have a sense of how frequently it's advisable to run snscrape and if there are risks of throttling, blacklisting.

I'm setting it to run every 30 seconds, think that would raise any flags? Ideally, running it every 5 seconds would make the bot's response snappier.

Thanks in advance!

plebiolira commented 1 year ago

Got a reply from manueltonneau with a related topic. Appreciate the help.

Basically, keep usage low and hope for the best. Switch IP address if issues arise.

754