elixir-crawly / crawly

Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
976 stars 115 forks source link

Observed crash of Genserver #184

Open bapti opened 3 years ago

bapti commented 3 years ago

image

I see this error thrown in my logs fairly regularly, it doesn't seem to follow a deterministic pattern though so I thought I'd raise it to see if you've seen it before. Perhaps I've misconfigured Crawly?

Ziinc commented 3 years ago

Did you get this logged? https://github.com/elixir-crawly/crawly/blob/c02e408dc84754bf8903515a9906c36ee51d04c0/lib/crawly/manager.ex#L216

If so, then you can disable the itemcount_timeout by setting it to false or a very high number.