Open YousufSSyed opened 3 years ago
Are you primarily looking at something that can crawl several pages automatically, right? Currently, we have browsertrix-crawler that can be used for more automated archiving.
The way Chrome extensions work currently, starting in all tabs simultaneously might not yield the best performance, and I've noticed that when one tab that's being recorded closes, it disconnects from all of them (due to a bug in Chromium) but in theory is doable. Will let you know if there's more updates on this.
I tried the extension again, and found that now it works well with recording several tabs simultaneously, and without having to resume or restart the crawler. Has anything changed with archiveweb.page to make that possible?
I need to make an archive that requires a login (I wish I could use Pywb but the OneLogin service has issues with it) and need to save a whole bunch of links, so pressing the start button over and over again would be very tedious.