search

MatrixAI / Emergence

Distributed Infrastructure Orchestration
Apache License 2.0
1 stars 0 forks source link

Identify CI stages - sequence diagram. #21

Open mokuki082 opened 6 years ago

mokuki082 commented 6 years ago

Map test stages to Matrix Forge

CMCDragonkai commented 6 years ago

Investigate the application of Hydra https://nixos.org/hydra/ for usage of building container images and archives. It also has a paper, but apparently out of date. The manual is more up to date.

It may be difficult to bind into a complex system as hydra as it is not a library. So maybe we can take ideas and break it down to just what we need.

CMCDragonkai commented 6 years ago

Buildkit takes Dockerfile source and produces LLB (intermediate binary format), and executes the intermediate binary format (somehow...)

LLB is defined via protobuf protocol. We can use autogeneration for marshalling and unmarshalling haskell libraries to deal with this. A possible opportunity is to convert Nix expressions into LLB, instead of directly using Dockerfiles. Remember that this depends on the market. If the market wants to use Dockerfiles, then we support this.

mokuki082 commented 5 years ago

Here is a note on CI/CD with no implementation details

Next step is to look into Hydra and how CI/CD is actually implemented.