KonradHoeffner / hdt

Library for the Header Dictionary Triples (HDT) compression file format for RDF data.
https://crates.io/crates/hdt
MIT License
19 stars 4 forks source link

crates.io and test resources #1

Closed KonradHoeffner closed 1 year ago

KonradHoeffner commented 1 year ago

Due to the test HDT file tests/resources/swdf.hdt (5.9 MB uncompressed), the hdt package uses 2.42 MB on crates.io, which is much more than other crates typically use. While this is not much, the eternal nature of crates.io motivates saving space. Thus, the filesize of the package should be significantly reduced before publishing a new version.

Options

  1. keep it like it is now
  2. use a smaller HDT test file
  3. download the test file when required so that users who don't need the tests don't download it
  4. automatically generate the test file
KonradHoeffner commented 1 year ago

https://crates.io/crates/brotli-decompressor/2.3.2 also has large amounts of test data

KonradHoeffner commented 1 year ago

Use SNIK meta instead.