search

airavata-courses / NSA

Weather Data Gateway
1 stars 4 forks source link

Dockerize data-retrieval #51

Closed aniruddhavpatil closed 4 years ago

aniruddhavpatil commented 4 years ago

Dockerize the data-retrieval service and have it correctly connect to kafka on kafka:9092.

aniruddhavpatil commented 4 years ago

Is a subpart of #43

aniruddhavpatil commented 4 years ago

I took a deep dive into the kafka-python repository and found some potentially useful things for later. Turns out that the KafkaConsumer, has some threading issue that can be solved by monkey patching:

https://github.com/dpkp/kafka-python/issues/1867 https://github.com/dpkp/kafka-python/issues/1989