spkenv / spk

A Package Manager for high velocity software environments, built on spfs.
https://spkenv.dev
Apache License 2.0
38 stars 6 forks source link

Local Monorepo Build Orchestration #1121

Open rydrman opened 2 months ago

rydrman commented 2 months ago

Is your feature request related to a problem? Please describe.

At ILM, we have a distinct workflow where many packages are maintained from a single repo (not currently spk). Our developer and CI workflows operate on "collections" that construct a simple dependency DAG and then build packages that don't exist in order. Notably, the package recipes work for all possible versions of the package and so the version is provided by the collection, not the package spec.

Describe the solution you'd like

We would like to convert these packages into spk packages and then have a way to orchestrate builds in the same way using spk.

Describe alternatives you've considered

We could hook spk into our existing system, eg build the DAG ourselves and then invoke spk, but resolving the dependencies properly in such a DAG is difficult due to spk spec files being difficult to introspect from the outside, especially as a set of var options are included in the picture.

rydrman commented 1 month ago

From the meeting today: