search

hmol / LinkCrawler

Find broken links in webpage
MIT License
117 stars 59 forks source link

Support sites with login or with age gate #32

Open firecodergithub opened 7 years ago

firecodergithub commented 7 years ago

As an extra feature I think it would be beneficial if this supported sites that block first page with age gate or that have login (and most of the content is after login only)

tdwright commented 6 years ago

I can see why that would be useful, but I'm not sure how we'd be able to write a general solution for this. Surely all the logins / age-gates will have their own form that we'd need to complete? What did you have in mind?