ArchiveTeam / grab-site

The archivist's web crawler: WARC output, dashboard for all crawls, dynamic ignore patterns
Other
1.32k stars 130 forks source link

Can no longer archive tumblr blogs from Europe #124

Closed ivan closed 6 years ago

ivan commented 6 years ago

tumblr now serves a redirect to https://www.tumblr.com/privacy/consent?... and sets a long HttpOnly GDPR consent cookie.

ivan commented 6 years ago

Fixed in 5bc2069d9b19ff729910a50c9b71cb629a48e728

Thanks to https://github.com/FreshRSS/FreshRSS/pull/1924/commits/06a0210e93d434e111eaa0c4dbc7fb732af8a316 for the hint