[docker] container or composition of services for e2e processing

ml4ai / skema

SKEMA: Scientific Knowledge Extraction and Model Analysis

https://ml4ai.github.io/skema/

Other

10 stars 4 forks source link

[docker] container or composition of services for e2e processing #213

Closed jastier closed 1 year ago

jastier commented 1 year ago

Implement interprocess communication within Docker

The SKEMA architecture (.pdf and .graffle files) are on a Google drive here

Create branch 'docker_integration' (done)
Create network service 'skema_net'. docker-compose.yml will create this network if needed (done)
Add this service to existing compose files (done)
Test REST API comms end to end (skema-rs, skema-py servers are active on skema_net)

When building images to push to DockerHub, use the following naming convention from Issue ml4ai/skema#221:

### Tasks
- [ ] https://github.com/ml4ai/skema/issues/221
- [ ] https://github.com/ml4ai/ASKEM-TA1-DockerVM/issues/19

myedibleenso commented 1 year ago

Let's use this issue to document our conversation around service orchestration.

enoriega commented 1 year ago

Hi guys. The TA-1 orchestration repository lives at https://github.com/ml4ai/ASKEM-TA1-DockerVM/

This is where Chunwei and I have started work to consolidate our TR apis.

Should we use that repository to manage the orchestration of the rest of the Skema images too?

myedibleenso commented 1 year ago

Are all of our compose files for service orchestration going to live in https://github.com/ml4ai/ASKEM-TA1-DockerVM/ for the time being? Do we want to do the same with example notebooks?

enoriega commented 1 year ago

It is my understanding that yes, that is the current agreement. https://mlbayes.slack.com/archives/C05AD8860S2/p1686162741083959

The notebooks should live on the same place as the compose file, as they're the documentation on how to use them for TA-4

enoriega commented 1 year ago

One additional repo has a docker image part of this integration project. The image is currently hand built and pushed into my personal hub account. @myedibleenso can you help replicate the config to do it automatically to our organization's hub?

https://github.com/ml4ai/ASKEM-TA1-DataModel/issues/15

jastier commented 1 year ago

I believe this was completed for the June 28 Uncharted demo and was never closed out.

myedibleenso commented 1 year ago

Completed prior to start of hackathon.