datawire / forge

Define and run multi-container apps in Kubernetes
http://forge.sh
Apache License 2.0
415 stars 43 forks source link

Ability to control build parallelism #208

Closed arvola closed 6 years ago

arvola commented 6 years ago

It would be very useful to have a way to control how much Forge parallelizes builds. At minimum viable, Forge should allow turning parallelization off.

Background: Running builds in parallel can lead to the following Docker bug: https://github.com/moby/moby/issues/9656 - depending on the number of builds and if they share file system layers. It can make builds take an order of magnitude longer. In my case, a 5 minute build could take up to 2 hours.

rhs commented 6 years ago

This should be fixed in 0.4.14. You can set the concurrency parameter in forge.yaml (it now defaults to 5 so you may not need to set it).