search

KonradHoeffner / hdt

Library for the Header Dictionary Triples (HDT) compression file format for RDF data.
https://crates.io/crates/hdt
MIT License
19 stars 4 forks source link

read compressed hdt #8

Closed KonradHoeffner closed 1 year ago

KonradHoeffner commented 1 year ago

For example brotli.

KonradHoeffner commented 1 year ago

bz2 and gzip seem to be used the most. However it probably makes more sense to just allow reading from a buffered reader and then users of the library can use a streaming decompressor in their own code. We could use that a decompressor as a test dependency to reduce the size of the test data, see #1. However on crates.io, packages seem to be compressed anyways.