ArchiveTeam / grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Other
1.35k stars 134 forks source link

Allow changing the websocket endpoint via a control file #78

Open ivan opened 8 years ago

ivan commented 8 years ago

This will make things like https://github.com/ludios/grab-site/pull/76#issuecomment-188513711 less of a problem in the future for long-running crawls