search

elixir-crawly / crawly

Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
976 stars 115 forks source link

Any working examples? #210

Closed dogweather closed 2 years ago

dogweather commented 2 years ago

I've tried many tutorials and demos, but none of them have worked for me. Either it appears to run but I get no output file, or a puzzling function Crawly.fetch/1 is undefined or private.

I'm using elixir 1.13.4-otp-24 and erlang 24.3.4.2. (Not using 25 because it's not compatible with the Elixir LS / VS Code extension.)

Can someone point to verified-working demo code?

I'm really intrigued by Crawly, and have a large Scrapy project I'd consider migrating from.

oltarasenko commented 2 years ago

Could you please try an example in the examples folder of the project? It is supposed to work

dogweather commented 2 years ago

Could you please try an example in the examples folder of the project? It is supposed to work

Yep, giving it a shot now.

dogweather commented 2 years ago

Yes, it definitely worked. Thank you. I followed the instructions from the main README for it. I got the results in /tmp as promised.

dogweather commented 2 years ago

All the tests passed for me too - the framework's as well as the examples. In the framework, I'm using asdf to provide:

elixir 1.14.0-otp-24
erlang 24.3.4.2