Add config option for over-the-wire format

internetarchive / liveweb

Liveweb proxy of the Wayback Machine project

https://web.archive.org/

44 stars 13 forks source link

Add config option for over-the-wire format #28

Closed rajbot closed 12 years ago

rajbot commented 12 years ago

The over-the-wire format should be settable to arc, warc, or http passthrough.

The wayback machine may eventually change to warc.

The ability to operate in passthrough mode would make this package useful for other crawling projects, or even as a recording proxy for your own personal browsing.

anandology commented 12 years ago

Done.

writing arc or warc is a separate issue.