Add S3 stack - Githubissues

RADAR-base / RADAR-Docker

Integrated Docker Stack for the RADAR mHealth Streaming Platform Components

https://hub.docker.com/u/radarbase/dashboard/

Apache License 2.0

16 stars 16 forks source link

Add S3 stack #218

Closed nivemaham closed 3 years ago

nivemaham commented 4 years ago

This aims to provide a parallel stack which replaces HDFS with Minio. It also removes dashboard pipeline into a separate docker-compose. It has been only tested on localhost and more fine tuning is expected from PR reviews.

TODO:

[ ] add set-up of upload connector to optional services
[x] get output-redis service healthy
[x] more tests
[x] run minio behind nginx. In the view of time, I have decided to skip integrating upload connector ATM.

blootsvoets commented 4 years ago

Agree with some of @yatharthranjan comments, some of the lib and maybe even bin can definitely be reused. However, I would opt for a separate issue/PR to generalise from what we have, reusing code where possible, since we would like to have an S3 stack working in the short-to-medium term.

nivemaham commented 4 years ago

@blootsvoets @yatharthranjan Are you guys OK with removing the radar-cp-stack folder? I removed it since I have almost never used it. I agree that the scripts can be better arranged to be reused instead of duplication. I prefer to move it to a separate PR though.

nivemaham commented 3 years ago

@blootsvoets @yatharthranjan It turns out there were some glitches in the PR. I fixed them when I tried to set it up on a VM. Could you please review it again?