Open JustAnotherArchivist opened 2 years ago
I don't think I want to log every single URL that is ignored by default, but I would merge this if it were activated by some option.
I am open to being convinced that I must log every URL that is ignored, but most users seem to have been fine without it, and it increases both disk usage and possibly makes the logs very noisy on some sites.
Example output from
grab-site --concurrency 1 --delay 5000 https://www.example.org/
: