unclecode / crawl4ai

🔥🕷️ Crawl4AI: Open-source LLM Friendly Web Crawler & Scrapper
Apache License 2.0
16.38k stars 1.2k forks source link

fix: crawler strategy exception handling and fixes #271

Closed NanmiCoder closed 2 days ago

NanmiCoder commented 5 days ago

Bug Description:

The following code captures exceptions but is missing the variable e. If this exception occurs, the program will lack the variable e and will panic.

https://github.com/unclecode/crawl4ai/blob/38044d4afe16b48783457e5ec8538e0a7592e16b/crawl4ai/crawler_strategy.py#L286-L289

unclecode commented 2 days ago

Thanks for collaboration