Giglium / vinted_scraper

A very simple Python package that scrapes the Vinted website to retrieve information about its items.
MIT License
15 stars 3 forks source link

Cannot fetch session cookie from #51

Closed roby222 closed 4 months ago

roby222 commented 4 months ago

Sometimes I encountered this random failure using vinted.it domain for my search:

" File "/vinted_env/lib/python3.12/site-packages/vinted_scraper/vintedWrapper.py", line 66, in _fetch_cookie raise RuntimeError(f"Cannot fetch session cookie from {self.baseurl}") "

Is it possible to add a retry mechanism?

thank you

Giglium commented 4 months ago

Great idea! I've encountered the same problems and it's especially annoying in the pipeline. I've added a 3 times retry with a progressive timeout. You will found it on the version 2.3.0