This pull request create a new small method to generate HDT, catTree.
This method create small HDTs using the generateHDT method and HDTCat them to reduce memory usage or being able to create HDTs without having the memory to store it.
API Changes
It add 3 new methods in HDTManager and 3 to implement
This pull request create a new small method to generate HDT,
catTree
.This method create small HDTs using the generateHDT method and HDTCat them to reduce memory usage or being able to create HDTs without having the memory to store it.
API Changes
It add 3 new methods in HDTManager and 3 to implement
It also 2 new classes to specify how to build the HDT with
HDTSupplier
and when to stop the RDF stream withRDFFluxStop
.Both HDTSupplier and RDFFluxStop have methods to quickly create instances.
It's also possible to use multiple limit with the
methods.
Core changes
Implementation of HDTCatTree with tests.
Some fixes on the header part with HDTCat.
Remove of the System.out.println during HDTCat to use the ProgressListener
API Changes
Add of the
-cattreelocation
and-cattree
options to therdf2hdt
command to use HDTCatTree.