search

juliomalegria / python-craigslist

Simple Craigslist wrapper
MIT No Attribution
387 stars 117 forks source link

Request failed #76

Open damanc7 opened 4 years ago

damanc7 commented 4 years ago

I'm getting a 'request failed, retrying' I'm polling every 3 mins, should I wait longer? Request failed (('Connection aborted.', ConnectionResetError(10054, 'An existing connection was forcibly closed by the remote host', None, 10054, None))). Retrying ...

damanc7 commented 4 years ago

Capture

juliomalegria commented 4 years ago

Mmmm, might be that Craigslist is throttling your requests? Did this suddently stop working? Does the error go away after not sending further requests for say 1h? If so, it definitely sounds like throttling. Otherwise I could take a deeper look. Can you share what command are you exactly calling, and every how often?

mnowicky commented 3 years ago

It looks to me like you probably have a while loop that doesn't have any wait time ( ex. time.sleep(1) or something) implemented into it. So you're essentially just opening tons of connections to CL which obviously looks like a DDoS attack on their end and gets shut down.

Edit- you say you're polling every 3 mins... but how exactly do you have that implemented?