elixir-crawly / crawly

Crawly, a high-level web crawling & scraping framework for Elixir.
https://hexdocs.pm/crawly
Apache License 2.0
965 stars 113 forks source link

Use a more reliable website to crawl in tutorial #209

Closed james-s-w-clark closed 1 year ago

james-s-w-clark commented 2 years ago

The tutorial uses the homebase site. I think the site layout has changed - for example, there's no body returned for this code in the tutorial:

iex(3)> response = Crawly.fetch("https://www.homebase.co.uk/our-range/tools")
%HTTPoison.Response{
  body: "",

A more reliable alternative might be some options from

oltarasenko commented 1 year ago

Yeah, I have removed the tutorial in favour of the quickstart. Maybe having more sites in the examples folder would be our better target