streamnative / kop

Kafka-on-Pulsar - A protocol handler that brings native Kafka protocol to Apache Pulsar
https://streamnative.io/docs/kop
Apache License 2.0
447 stars 132 forks source link

[BUG] Producer for nodejs client for confluent kafka not sending events to KOP #1446

Open chandrashekhar-macrometa opened 1 year ago

chandrashekhar-macrometa commented 1 year ago

Describe the bug

Producer code for nodejs (node-rdkafka) is not able to send events to KOP

The nodejs client does not call KafkaCommandDecoder.channelRead method to send events.

I am using following code for Producer

const path = require('path');
const kafka = require('node-rdkafka');

var listener = "localhost:9092";
var topic = "persistent://tenant1/testnm/topic1";

    const producer = new kafka.Producer({
        'bootstrap.servers': listener
      });

    producer
      .on('ready', () => {

        for (let idx = 0; idx < 30; ++idx) {
            const key = 'my_key';
            const value = Buffer.from(JSON.stringify({ count: idx }));

            console.log(`Producing record ${key}\t${value}`);

            producer.produce(topic, -1, value, key);
          }

          producer.disconnect();

      })
      .on('event.error', (err) => {
        console.warn('event.error', err);
        reject(err);
      });

    producer.connect();
BewareMyPower commented 1 year ago

The nodejs client does not call KafkaCommandDecoder.channelRead method to send events.

How do you come to this conclusion?

It would be helpful to upload your broker's debug logs.