search

ArchiveTeam / grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Other
1.31k stars 129 forks source link

Add a --no-global-igset option #224

Closed ivan closed 1 year ago

ivan commented 1 year ago

(Because we might have other unwanted ignores, in some cases. #223)

ivan commented 1 year ago

Implemented in https://github.com/ArchiveTeam/grab-site/compare/2.2.5...2.2.6