search

elixir-crawly / crawly

Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
976 stars 115 forks source link

Spider and Configuration generators #240

Closed oltarasenko closed 1 year ago

oltarasenko commented 1 year ago

The current commit introduces two mix commands which are supposed to speed up spider/configuration creation for Crawly projects.

This is one of the features used in Scrapy, and it allows you to make spiders almost instantly with just one command. It simplifies my work, and hopefully, it will be helpful for others as well!

dogweather commented 1 year ago

Thank you, @oltarasenko I'll take a look.

FYI, I'm really enjoying using Crawly. It's a good alternative to Scrapy. It's much nicer to be working in Elixir.

oltarasenko commented 1 year ago

Thank you, @oltarasenko I'll take a look.

FYI, I'm really enjoying using Crawly. It's a good alternative to Scrapy. It's much nicer to be working in Elixir.

Thanks for kind words! It's quite helpful to know that my work is needed by someone else!