search

grantwilliams / wg-gesucht-crawler-cli

Python web crawler / scraper for WG-Gesucht. Crawls the WG-Gesucht site for new apartment listings and send a message to the poster, based off your saved filters and saved text
MIT License
76 stars 28 forks source link

Error while saving an ad #9

Closed alexteua closed 5 years ago

alexteua commented 5 years ago

On some ads a crash is happening for the ads with long names:

python3.6/site-packages/wg_gesucht/crawler.py", line 293, in update_files 'w', encoding='utf-8') as outfile: OSError: [Errno 36] File name too long

grantwilliams commented 5 years ago

Hey, just pushed some changes, it should be ok now

alexteua commented 5 years ago

hey, thanks for the quick response! unfortunately, still happening.

grantwilliams commented 5 years ago

Hmm ok, I've just made it catch and log that error, so it won't save any ads offline if the name is too long