fimad / scalpel

A high level web scraping library for Haskell.
Apache License 2.0
323 stars 43 forks source link

Remove dependency on curl #73

Closed fimad closed 5 years ago

fimad commented 5 years ago

This replaces 'curl' with 'http-client'/'http-client-tls' and updates the related 'scrapeURL*' APIs accordingly.

In addition to the obvious API changes there is the additional behavior change where scrapeURL now throws an exception if there is a networking error instead of returning Nothing. This makes HTML scraping errors distinguishable from networking issues.

Issue #58