internetarchive / brozzler

brozzler - distributed browser-based web crawler
Apache License 2.0
648 stars 96 forks source link

In Logins, Check remember me box #235

Open TheTechRobo opened 2 years ago

TheTechRobo commented 2 years ago

Sometimes the chromium browser crashes (or locks up so I have to close it to reload it). That's not what I'm reporting - they're probably not actually bugs (lol).

But when that does happen, it's annoying to have to reauth for all pages - and actually could result in an incomplete crawl.

My Proposal: Add a bit more logic to the username/password fields to check for remember me boxes.