nodefluent / node-sinek

:tophat: Most advanced high level Node.js Kafka client
MIT License
290 stars 52 forks source link

Error when kafka topic has more than one partition #174

Open cferrera opened 2 years ago

cferrera commented 2 years ago

Hello!

I'm facing the following error when I try to produce a message to a kafka topic that has more than one partition. I've tried the exactly code on topics with 1, 2, 3 and 4 partitions and it only works for topics with 1 partition.

TypeError: Cannot read property 'v3' of undefined
    at JSProducer._murmur (~/node_modules/sinek/dist/lib/kafkajs/JSProducer.js:108:77)
    at JSProducer._getPartitionForKey (~/node_modules/sinek/dist/lib/kafkajs/JSProducer.js:206:21)
    at JSProducer.<anonymous> (~/node_modules/sinek/dist/lib/kafkajs/JSProducer.js:254:34)
    at Generator.next (<anonymous>)
    at fulfilled (~/node_modules/sinek/dist/lib/kafkajs/JSProducer.js:5:58)

I was able to track the issue a little bit:

This is the piece where the code breaks:

case "3":
  this._murmur = (key, partitionCount) => murmurhash_1.murmur.v3(key) % partitionCount;
  break;

it states that "murmur" is undefined. Removing "murmur" from the call - leaving only murmurhash_1.v3(key) - it works just fine. 👌

Going into a little further into murmurhash package, we can find this, a conditional on how the value will be exported.

I don't know when a module has type undefined but on every test that I did it was always a typeof object.

Going back to JSProducer, replacing this: https://github.com/nodefluent/node-sinek/blob/48e84257a7157ece410e22ba6a47460c9df7aac3/src/lib/kafkajs/JSProducer.ts#L5 with this

 import * as murmur from "murmurhash"; 

worked for me.

Not sure if anyone else has the same issue or if I'm doing something wrong but please let me know, other than that, if this replace sounds correct, will be a pleasure to contribute with a PR.

Thanks in advance. ✌️