bisguzar / twitter-scraper

Scrape the Twitter Frontend API without authentication.
MIT License
3.88k stars 601 forks source link

Properly close the connections #171

Open idev opened 3 years ago

idev commented 3 years ago

Hello,

first of all, thank you for your work - awesome tool.

I think I stumble about a issue regarding handling connections.

If connections are not properly closed, they kept alive, which leads to errors: https://stackoverflow.com/questions/10115126/python-requests-close-http-connection So as far as I understand there are two options, to set headers properly (keep-alive: false, or to close the request at the end).

My problem is the following error: requests.exceptions.ConnectionError: ('Connection aborted.', TimeoutError(10060, ....) which is happening if i try to get_tweets every 3600 seconds in a while true loop.

Kind regards