search

internetarchive / warcprox

WARC writing MITM HTTP/S proxy
371 stars 54 forks source link

New option --subdir-prefix #198

Closed vbanos closed 1 month ago

vbanos commented 1 month ago

Save WARCs in subdirectories equal to the current value of Warcprox-Meta['warc-prefix']. E.g. if warc-prefix=='spn2' and --dir=/warcs, save them in /warcs/spn2/.

vbanos commented 1 month ago

The aim is to be able to save WARCS in multiple subdirectories at the same time. Then, each subdirectory can be put to a different IA collection.