The filename pattern should support more keywords - Githubissues

internetarchive / liveweb

Liveweb proxy of the Wayback Machine project

https://web.archive.org/

44 stars 13 forks source link

The filename pattern should support more keywords #32

Closed anandology closed 12 years ago

anandology commented 12 years ago

The draintasker, the scripts to upload arc/warc files into petabox, supports two filename patterns.

{TLA}-{timestamp}-{serial}-{fqdn}.warc.gz
{TLA}-{timestamp}-{serial}-{PID}~{fqdn}~{port}.warc.gz

The FilePool should support the following three additional keyword parameters in the pattern, so that we can use configure it to use those pattens.

fqdn (fully qualified domain name)
port (expect it as a environment variable LIVEWEB_PORT)
pid

Also, it might be nice if we rename seq as serial, to be consistent with draintasker.

anandology commented 12 years ago

Also make sure the resolution of timestamp matches with that of existing files.

http://archive.org/details/webgroup-20100502050648-00085