Closed dabdine-r7 closed 5 years ago
I'm retiring this PR for now. We can reopen if we want it later. However, we weren't seeing what we needed to with badger to warrant supporting this feature.
I've ported all the other features (remove/join filters, and signal handling) EXCEPT for the use of jsoniter into master
What does this do?
Add support for the badger key/value database by dgraph-io.
Features added
badger
input and output. This allows reading from, and writing to, badger.join
. This filter allows clients to join one or moresource
fields of a document (separated by a comma) into a destination fielddest
using some supplied (default to comma,
) separatorsep
.jsoniter
golang json package for performance. This library touts much faster json read performance than the nativeencoding/json
library that ships with go. Additionally, it has support for one-time configuration of a JSON parser that usesUseNumber
. With the golang standard JSON library, this option is only exposed / configurable with aDecoder
, which must be instantiated per read source. Using jsoniter allows us to reduce memory and CPU usage per line of read data.TODO
Example usage