Add authentication to scrapers

ed36080666 / site_scraper

Web application for managing and scraping individual videos from a couple various porn sites. Currently supports PornHub, PornTrex, PornWild, PornKTube, HQPorner, PornPics, & PicHunter

28 stars 7 forks source link

Add authentication to scrapers #16

Open ed36080666 opened 1 year ago

ed36080666 commented 1 year ago

Although the config is setup to add auth credentials, most of the scrapers don't actually handle auth. Audit the scrapers and add auth to them as necessary.

In-progress list of scrapers:

[x] Porntrex
[x] Pornwild
[ ] PornKtube
[ ] HqPorner
[ ] PornHub
[ ] PornPics
[ ] PicHunter
[ ] WhoresHub

ed36080666 commented 1 year ago

I'm not sure if all these sites even follow the pattern of being hidden behind login. If this isn't an issue for some of these sites, we should remove the creds from configs to avoid confusion.