Configure the controller and data node containers to send log to CW

[tschaffter]

Depends on #33

There are three properties to configure for each container:

• --log-driver=awslogs
• --log-opt awslogs-group=docker-logs
• --log-opt awslogs-stream={container-name} where {container-name} takes one of these value: controller, data-node.

These log will be useful to troubleshoot #35 .

[tschaffter]

@thomasyu888 Note that MCW should not use the aws logging driver. Is there a way to parametrize the log driver, e.g. via a .env file?

[thomasyu888]

@tschaffter, this is just included in the docker run command right? I would need to figure out how to use this: https://docker-py.readthedocs.io/en/stable/api.html#docker.types.LogConfig for the submissions. As for the data-node, I can't seem to find the official docker-compose specs on logging, but there seems to be a section for it: https://stackoverflow.com/questions/43486505/docker-compose-json-logging-driver-labels-env.

For the data node, we can definitely have different .env files per data site so that they don't utilize the aws logging driver. As for the submissions themselves, we would just have different logging configurations within python as linked above. Unsure of bandwidth to tackle this.

[tschaffter]

Let's review this together tomorrow morning during our 1:1

[tschaffter]

https://docs.docker.com/config/containers/logging/awslogs/