Murali-group / GraphSpace

The interactive graph sharing website.
http://graphspace.org
GNU General Public License v2.0
30 stars 41 forks source link

A better way to implement Kafka consumers #376

Open melvin15may opened 6 years ago

melvin15may commented 6 years ago

As the number of kafka consumer grows, we should think of moving them to a separate app. Right now kafka consumers run in the background as a separate thread. This makes it extremely difficult to pinpoint errors.

Add suggestions here on how to better setup Kafka and structure the producer-consumers.