search

TREMA-UNH / trec-car-tools

Tools for working with the TREC CAR dataset.
http://trec-car.cs.unh.edu/
BSD 3-Clause "New" or "Revised" License
36 stars 14 forks source link

Zipping cbor #3

Closed laura-dietz closed 7 years ago

laura-dietz commented 7 years ago

Suggestion to distibute zipped cbor, and tooling support reads the zipped stream directly

laura-dietz commented 7 years ago

It's not clear that the pay-off here would be worthwhile,

-rw-r--r-- 1 ben ben 844M Jan  9 20:02 enwiki-20161220-pages-articles24.xml-p030503454p033952815.cbor
-rw-r--r-- 1 ben ben 323M Jan  9 20:02 enwiki-20161220-pages-articles24.xml-p030503454p033952815.cbor.gz
laura-dietz commented 7 years ago

wont fix