search

nix-community / nix-eval-jobs

Parallel nix evaluator with a streamable json output [maintainers @Mic92, @adisbladis]
GNU General Public License v3.0
140 stars 26 forks source link

Tests aren't run in the derivation for nix-eval-jobs #296

Open lf- opened 4 months ago

lf- commented 4 months ago

It would be good if nix-eval-jobs meson ran tests, which would in turn make the derivation run the tests

Mic92 commented 4 months ago

Those test needs a writeable store. It requires a bit of effort to make this work inside nix build i.e. using a different store.

lf- commented 4 months ago

oh, reminds me of the NixOS tests we reviewed recently on an internal project. they use .inputDerivation and then some extra store paths mechanism we forget, which pulls the dependencies for the test into the store making it offline compatible. but definitely annoying to need such a methodology.

does n-e-j test need merely a writable store (in which case nix copy and setting --store for the tests would suffice) or does it need to execute builds on it (in which case you probably need the NixOS test described above)?