simplecto / sitemap_grabber

A python library to recursively crawl every sitemap.xml and every url in those sitemaps.
MIT License
0 stars 0 forks source link

Need some exception handling for when the timeout is exceeded #5

Open undernewmanagement opened 4 weeks ago

undernewmanagement commented 4 weeks ago

https://github.com/simplecto/sitemap_grabber/blob/dcb1fe265f51747293a2e0e7900d8e6ca997ccfd/src/sitemap_grabber/sitemap_grabber.py#L32

undernewmanagement commented 4 weeks ago

also here

https://github.com/simplecto/sitemap_grabber/blob/dcb1fe265f51747293a2e0e7900d8e6ca997ccfd/src/sitemap_grabber/sitemap_grabber.py#L53