--igsets=singletumblr misbehaves when start URL lacks trailing slash

ArchiveTeam / grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns

Other

1.31k stars 129 forks source link

Open ivan opened 5 years ago

ivan commented 5 years ago

e.g.

grab-site https://staff.tumblr.com --igsets=singletumblr

does not grab anything.