issues
search
ukwa
/
ukwa-services
Deployment configuration for all UKWA services stacks.
Apache License 2.0
4
stars
5
forks
source link
Integrate the results from Browsertrix Cloud
#122
Open
anjackson
opened
8 months ago
anjackson
commented
8 months ago
Following #121, to integrate the results:
Must define an internal protocol, e.g. a specific tag, to make collection as complete and ready to upload.
Dedup?
WACZ and even WARC naming conventions?
Must be able to upload WACZ to HDFS.
https://github.com/ukwa/ukwa-manage/issues/114
Must be able to index the WACZ file into out OutbackCDX service.
See
https://github.com/ukwa/ukwa-manage/issues/113
Should use the more recent OutbackCDX CDXJ support (
including upgrading the index
)
Following #121, to integrate the results: