search

john-hu / untitled

0 stars 0 forks source link

we should trim whitespaces when get an URL #103

Closed john-hu closed 2 years ago

john-hu commented 2 years ago 
2021-12-28 00:21:03 [scrapy.extensions.logstats] INFO: Crawled 3 pages (at 2 pages/min), scraped 0 items (at 0 items/min)
2021-12-28 00:21:22 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://www.bettycrocker.com/404?aspxerrorpath=/how-to/equipment> from <GET https://www.bettycrocker.com/how-to/equipment%20>
2021-12-28 00:22:00 [scrapy.downloadermiddlewares.redirect] DEBUG: Redirecting (302) to <GET https://www.bettycrocker.com/404?aspxerrorpath=/how-to/holidays-and-entertaining> from <GET https://www.bettycrocker.com/how-to/holidays-and-entertaining%20>