search

iipc / openwayback

The OpenWayback Development
http://www.netpreserve.org/openwayback
Apache License 2.0
486 stars 275 forks source link

Avoid dependency on heritrix-commons SNAPSHOT release #11

Closed anjackson closed 10 years ago

anjackson commented 11 years ago

The code is critically dependent on the heritrix-commons codebase, mainly for the WARC readers/writers. API changes between 3.1.1 and 3.1.2-SNAPSHOT mean that we cannot rely on a proper release at the moment.

This is really rather bad practice for code stability, as the dependant code can shift from underneath us, and this is even more pressing as the two codebases are now under the control of different groups.

Easiest solution is probably for IA to make a 3.1.2 release. Best solution is probably to pull the ARC/WARC code out into a separate project AND/OR shift over to the JWAT implementation. Clumsy fallback would be to make an IIPC release of H3 and depend on that instead.

egh commented 10 years ago

I believe this is done?

anjackson commented 10 years ago

Yes, thanks to @nlevitt's work, the critical code for OpenWayback has been moved into commons-web (see his last two most recent commits). The test suite has not been moved over yet, but that perhaps belongs in a separate ticket.