search

airavata-courses / scapsulators

Looking to understand how weather phenomena in a region, affect your research? Well look no further!
https://github.com/airavata-courses/scapsulators/wiki/Weather-enthusiasts-assemble
Apache License 2.0
1 stars 2 forks source link

POC for Python Flask quicker S3 data access #2

Closed vikrantdeshpande09876 closed 2 years ago

vikrantdeshpande09876 commented 2 years ago

Conduct POC for quicker S3 data access, parsing and image generation based on requested parameters. Wrap the image generation code into a Flask microservice and send to Kafka consumer. Target-date is 22nd January 2022.

vikrantdeshpande09876 commented 2 years ago

Successfully connected 2 Flask microservices via Kafka for communicating asynchronously.

Next steps: Explore data more to finalize image generation algorithm. Transmit byte-encoded image via Kafka similarly.

vikrantdeshpande09876 commented 2 years ago

Assigning to Shubham for reviewing on his local. @shubhpatr - Can you take a look here?

shubhpatr commented 2 years ago

checked the code, seems to working fine!