jamesturk / scrapelib

⛏ a library for scraping unreliable pages
https://jamesturk.github.io/scrapelib/
BSD 2-Clause "Simplified" License
208 stars 40 forks source link

next version of scrapelib #223

Open jamesturk opened 1 year ago

jamesturk commented 1 year ago

My current thinking is that the next version of scrapelib should support httplib3 2.0 as well as 1.0 (as recommended here: https://urllib3.readthedocs.io/en/stable/v2-migration-guide.html), that'd probably be 2.3.

I've also had the idea to decouple from requests entirely (allowing direct usage of httplib3 and/or httpx), but would save that for a 3.0 release (or new library).

If you're seeing this issue, I'd love to know what is/isn't useful about the current version. Why do you use it & when do you hit pain points?