Resolve the issue of retrying redirectable connections, where the link has already been visited, resulting in the error "AlreadyVisitedUrl".
This change cannot avoid the "AlreadyVisitedUrl" error caused by the initial visit, but primarily addresses the "AlreadyVisitedUrl" error caused by retries, reducing the error loop caused by blind retries.
Resolve the issue of retrying redirectable connections, where the link has already been visited, resulting in the error "AlreadyVisitedUrl".
This change cannot avoid the "AlreadyVisitedUrl" error caused by the initial visit, but primarily addresses the "AlreadyVisitedUrl" error caused by retries, reducing the error loop caused by blind retries.
解决retry可以redirect的连接,但该redirect的链接已经被访问,导致返回AlreadyVisitedUrl错误问题 本次改变无法避免初次访问导致的AlreadyVisitedUrl错误,但主要解决retry导致的AlreadyVisitedUrl错误,减少无脑retry导致的错误循环
https://github.com/gocolly/colly/issues/805