search

internetarchive / brozzler

brozzler - distributed browser-based web crawler
Apache License 2.0
653 stars 96 forks source link

how do I add a cookies.txt file? #230

Open TheTechRobo opened 3 years ago

TheTechRobo commented 3 years ago

I'm trying to crawl a site that requires Google authentication. Brozzler does not seem to offer an option to add a cookies.txt; or did I miss something?

TheTechRobo commented 2 years ago

I see there's a way to pass in a Chrom* cookies database internally, but is that exposed?

I don't want to use the username/password field with the main reason being that I have no idea how to make it work the way I want it to.