Open sicholas opened 2 months ago
fwiw, i've been able to use a proxy server without a problem. have you tried to do it globally. something like:
tw_scrape_db = os.path.join(os_path, "accounts.db") token_pool = AccountsPool(db_file=tw_scrape_db) tw_scrape_api = API(pool=token_pool, proxy=proxy_url)
fwiw, i've been able to use a proxy server without a problem. have you tried to do it globally. something like:
tw_scrape_db = os.path.join(os_path, "accounts.db") token_pool = AccountsPool(db_file=tw_scrape_db) tw_scrape_api = API(pool=token_pool, proxy=proxy_url)
Sorry for the delayed response. What provider do you use and what type of proxy are you using (HTTP, HTTPS, SOCKS5)? Thanks again!
I've used royal and stormproxies. I settled on stormproxies residential as it's cheap, unlimited bandwidth and twitter doesn't seem to ban it so quickly. Http
@takabinance thank you so much and storm does rotating residential? So every request is randomized or are you just buying one singular static resi?
I think it rotates every 5 mins. They have a data center service that rotates on every request but felt like that was getting banned too often.
Have tried many proxy providers but haven't been able to get a single one to work with TWScrape. I receive no errors, just the scripts never do anything and sit there.
I have been adding proxies as so (have tried socks5, HTTP, and HTTPS):
Thanks!