BitFunnel / mg4j-workbench

Java tools for evaluating BitFunnel performance compared to an mg4j baseline.
GNU Lesser General Public License v3.0
1 stars 2 forks source link

Use a ConcatenatedDocumentCollection to combine chunk files #23

Open MikeHopcroft opened 7 years ago

MikeHopcroft commented 7 years ago

We should implement a class that creates a ConcatenatedDocumentCollection from a manifest file listing BitFunnel chunks. This will allow us to build the index in pieces. Orignally, we had though that we would have to build one collection for the entire index.

This new class will be passed to the IndexBuilder command line, the same way we pass ChunkDocumentSequence today.