search

internetarchive / brozzler

brozzler - distributed browser-based web crawler
Apache License 2.0
648 stars 96 forks source link

zlib compression for warcprox_meta blocks #249

Closed galgeek closed 2 years ago

galgeek commented 2 years ago

this update will require matching warcprox code & deployment.

it may also be good to try brotlipy