Allow document to use stream id more than once

BitFunnel / mg4j-workbench

Java tools for evaluating BitFunnel performance compared to an mg4j baseline.

GNU Lesser General Public License v3.0

1 stars 2 forks source link

Allow document to use stream id more than once #34

Closed jondgoodwin closed 6 years ago

jondgoodwin commented 6 years ago

The new BtiFunnel filter -write annotate option injects a shard term into its own stream, reusing the id for the main stream. This means two streams in a document might have the same id. Currently, however, the MG4J workbench disallows this when creating the MG4J index from BitFunnel chunks.

The attached commit removes this restriction.

MikeHopcroft commented 6 years ago

I don't understand why I restricted streams to a single instance. I'll merge this change.