Esri / kafka-for-geoevent

ArcGIS GeoEvent Server sample Kafka connectors for connecting to Apache Kafka message servers.
Apache License 2.0
14 stars 10 forks source link

Inputs & Output disappear after a reboot #9

Open ghost opened 7 years ago

ghost commented 7 years ago

KAFKA inputs and outputs disappear when restarting the machine. I have to recreate the inputs/outputs again.

Any solution?

I'm on ArcGIS Server 10.5

jpsphar1 commented 7 years ago

Hi Fadi, I am not entirely sure why they are disappearing as we have only seen that issue just once. One thing you can do is backup your configuration as an XML and then just reload that after restart if the inputs and outputs disappear. Also, I recently contacted Esri to trouble shoot some Kafka adapter errors on GeoEvent Server 10.5 and we eventually logged a bug because our environment was not working to receive messages properly. We have the same environment working well on 10.4.1 but on 10.5 the same setup causes some errors. They told me that the Kafka Adapter/GeoEvent Server for 10.5 has a small list of bugs and that different users are experiencing different activities. Some get it up and running and then encounter errors later on, some might be experiencing what you are describing and some are some are seeing the errors that we encountered where it was unable to receive a message properly. So, long story short, we have temporarily paused our efforts to get 10.5 working and are just using 10.4.1. I think that there is supposed to be a patch in the upcoming months to address these issues. I know this is not an answer but if choose to go through Esri support you might draw the same conclusion in working with them.

Good Luck, Jason

ghost commented 7 years ago

Hi Jason,

Thanks for the backup tip. I actually found the problem of why Kafka inputs and outputs disappear. It is because GeoEvent Server services are up before my local Kafka is and running. So GeoEvent was trying to connect to my brokers that are still not waken up so the inputs/outputs are not appearing on GeoEvent Server.

I expected GeoEvent to show stopped services until connecting to a remote or local Kafka servers.

When I made sure that my local Kafka brokers are up and running, I restarted GeoEvent Server and inputs/outputs are appearing again.

cdufault commented 5 years ago

Has there been any progress on this isssue? I'm finding it a problem after patch 2 on 10.5.1 GeoEvent running on RedHat 7.x.