jkcfg / kubernetes

Apache License 2.0
25 stars 6 forks source link

git submodule update --init --recursive takes a long time in CI #49

Closed dlespiau closed 4 years ago

dlespiau commented 5 years ago

This takes 4 minutes out of the 5 minutes we need for the CI passes. Maybe a shallow checkout (--depth) would help here?

squaremo commented 5 years ago

Oh whoops, yeah that's because of the submodule used for schema files. If we can restrict depth for that it would probably help -- or just vendor the files we need, since they mostly won't change.

squaremo commented 4 years ago

We only use the *-local files, but it's tricky to git clone or otherwise download just those. Possibly vendoring into a subtree is the way.

Slightly further out idea: if there were an image layer with each schema version, it might be possible to package things into an image such that only the necessary layer(s) were used.

squaremo commented 4 years ago

make dist now:

  1. Downloads a tarball rather than using a submodule;
  2. Gets it from jkcfg/kubernetes-schema, which has just the local schemas i.e., way fewer files;
  3. deduplicates the files that didn't change between versions

as of #60. Woo!