gocolly / colly

Elegant Scraper and Crawler Framework for Golang
https://go-colly.org/
Apache License 2.0
23.39k stars 1.77k forks source link

request chan error #778

Open JBossBC opened 1 year ago

JBossBC commented 1 year ago

image

when the high performance situation ,the colly chan will be blocked, cause the signal in channel cant be consumed with goroutinue

image

i analysis the code,and find the suspicious question, but i cant find the reason why the operation is blocked to defend this signal is received.

WGH- commented 1 year ago

I don't really understand the issue. Could you give a reproducible test case?

BTW, You're using old v1 colly, you should update to github.com/gocolly/colly/v2.