search

SkylineLabs / emqttd_kafka_bridge

A bridge to send mqtt messages received by the emqttd broker directly to kafka
Apache License 2.0
16 stars 17 forks source link

I don't see messages in Kafka even after enabling the plugin #3

Open dramasamy opened 6 years ago

dramasamy commented 6 years ago

Hi, I'm using emq 2.3.6 and emqttd_kafka_bridge, I don't see any issues in enabling the plugin, but when I consume I don't see messages.

Could you help me to find why the bridge is not pushing data?

JayLohokare commented 6 years ago

Hi @dramasamy the following could be possible reasons for the issue -

  1. We are aware about changes in EMQTT security layer, which might have changed the ACL part of the plugin. Try removing all ACL related code.
  2. The plugin is more than one year old, its possible that latest EMQTT or kafka releases could be incompatible.
  3. There could be minor issues that you are missing in the code (Like changing the IP or app name).

We will look into the code and try to debug, but do try the recommended changes till then.

dramasamy commented 6 years ago

Jay, thanks a lot. The ACL was the reason as you suspected.

JayLohokare commented 6 years ago

@dramasamy if possible, please make the changes and create a merge request. It will help others who might want to use this connector.

CoolemptyWen commented 5 years ago

hello @JayLohokare , after edit the kafka_bridege conf, I got problems when i tried to ./bin/emqx console....

the message looks like this:

Exec: /usr/local/emq-relx/_rel/emqx/erts-10.2/bin/erlexec -boot /usr/local/emq-relx/_rel/emqx/releases/3.0/emqx -mode embedded -boot_var ERTS_LIB_DIR /usr/local/emq-relx/_rel/emqx/erts-10.2/../lib -mnesia dir "/usr/local/emq-relx/_rel/emqx/data/mnesia/emqx@127.0.0.1" -config /usr/local/emq-relx/_rel/emqx/data/configs/app.2018.12.16.11.44.45.config -args_file /usr/local/emq-relx/_rel/emqx/data/configs/vm.2018.12.16.11.44.45.args -vm_args /usr/local/emq-relx/_rel/emqx/data/configs/vm.2018.12.16.11.44.45.args -- console Root: /usr/local/emq-relx/_rel/emqx /usr/local/emq-relx/_rel/emqx 2018-12-16 11:44:48.855096 application_controller: ~ts: ~ts~n ["syntax error before: ","'}'"] "}}/crash.dump" {"could not start kernel pid",application_controller,"{bad_environment_value,\"}}/crash.dump\"}"} could not start kernel pid (application_controller) ({bad_environment_value,"}}/crash.dump"})

Crash dump is being written to: {{...done

where would I go wrong? Thx...

FairyYao commented 5 years ago

Hi.@JayLohokare, How to remove all ACL related code.