rtyler / otto

Otto is your friendly continuous delivery companion.
GNU Affero General Public License v3.0
80 stars 5 forks source link

git step should cache cloned repos for re-use between pipeline runs #40

Closed rtyler closed 3 years ago

rtyler commented 3 years ago

Identified as part of #33

I think the right path forward is to not try to gain agent-level performance between pipeline runs by allowing them to share the same workspace over and over.

In order to avoid full re-cloning every time between the various runs of a single pipeline on an agent, the agent should have a cache directory where git repositories can be stored, and then perhaps hardlink or clone from the local disk storage in the pipeline workspace.

rtyler commented 3 years ago

Picked @markewaite's brain about this, and reference repositories look like a good way to solve this problem. I'll have to figure out the right strategy to use here however.