elixir-crawly / crawly

Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
976 stars 115 forks source link

Issue #144 #206

Closed matteoredaelli closed 2 years ago

matteoredaelli commented 2 years ago

https://github.com/elixir-crawly/crawly/issues/144

oltarasenko commented 2 years ago

I would prefer to solve it on a spider/middleware level instead of bringing it into the core