search

sntran / scrapex

An Elixir open source and collaborative framework for extracting the data you need from websites. In a fast, simple, yet extensible way. Or just an experiment writing a scraper in Elixir to scratch my own itch. Use at your own risk.
https://sntran.github.io/scrapex/doc/
MIT License
17 stars 2 forks source link

Convert relative URLs to absolute URL #11

Open sntran opened 7 years ago

sntran commented 7 years ago

So that we don't have to do this:

GenSpider.Response.url_join(response, href)

Which not only is an extra step, but also exposes the internal of GenSpider.