niv fetching seems to rebuild the world

[nomeata]

In version 7, in https://github.com/nomeata/kaleidogen/runs/2581090758 it seems that the installation doesn't hit the cache:

2021-05-14T04:16:41.9715314Z Download action repository 'knl/niv-updater-action@v9'
2021-05-14T04:16:43.9054288Z ##[group]Run knl/niv-updater-action@v9
2021-05-14T04:16:43.9055280Z with:
2021-05-14T04:16:43.9056232Z   branch_prefix: update/
2021-05-14T04:16:43.9056878Z   skip_versioned_revisions: true
2021-05-14T04:16:43.9057506Z   skip_ssh_repos: false
2021-05-14T04:16:43.9058068Z   show_merges: false
2021-05-14T04:16:43.9058687Z   sources_file: nix/sources.json
2021-05-14T04:16:43.9059247Z   niv_version: master
2021-05-14T04:16:43.9059875Z   keep_updating: false
2021-05-14T04:16:43.9060595Z   github_changelog_no_backreferences: true
2021-05-14T04:16:43.9061267Z   debug_output: false
2021-05-14T04:16:43.9061794Z env:
2021-05-14T04:16:43.9063041Z   GITHUB_TOKEN:  ***
2021-05-14T04:16:43.9063667Z ##[endgroup]
2021-05-14T04:16:44.7394765Z {
2021-05-14T04:16:44.7402652Z   "current_user_url": "https://api.github.com/user",
2021-05-14T04:16:44.7404213Z   "current_user_authorizations_html_url": "https://github.com/settings/connections/applications{/client_id}",
2021-05-14T04:16:44.7405653Z   "authorizations_url": "https://api.github.com/authorizations",
2021-05-14T04:16:44.7407477Z   "code_search_url": "https://api.github.com/search/code?q={query}{&page,per_page,sort,order}",
2021-05-14T04:16:44.7409122Z   "commit_search_url": "https://api.github.com/search/commits?q={query}{&page,per_page,sort,order}",
2021-05-14T04:16:44.7410571Z   "emails_url": "https://api.github.com/user/emails",
2021-05-14T04:16:44.7411611Z   "emojis_url": "https://api.github.com/emojis",
2021-05-14T04:16:44.7414053Z   "events_url": "https://api.github.com/events",
2021-05-14T04:16:44.7415334Z   "feeds_url": "https://api.github.com/feeds",
2021-05-14T04:16:44.7416314Z   "followers_url": "https://api.github.com/user/followers",
2021-05-14T04:16:44.7417767Z   "following_url": "https://api.github.com/user/following{/target}",
2021-05-14T04:16:44.7419328Z   "gists_url": "https://api.github.com/gists{/gist_id}",
2021-05-14T04:16:44.7420191Z   "hub_url": "https://api.github.com/hub",
2021-05-14T04:16:44.7421287Z   "issue_search_url": "https://api.github.com/search/issues?q={query}{&page,per_page,sort,order}",
2021-05-14T04:16:44.7422565Z   "issues_url": "https://api.github.com/issues",
2021-05-14T04:16:44.7423666Z   "keys_url": "https://api.github.com/user/keys",
2021-05-14T04:16:44.7424801Z   "label_search_url": "https://api.github.com/search/labels?q={query}&repository_id={repository_id}{&page,per_page}",
2021-05-14T04:16:44.7426058Z   "notifications_url": "https://api.github.com/notifications",
2021-05-14T04:16:44.7427994Z   "organization_url": "https://api.github.com/orgs/{org}",
2021-05-14T04:16:44.7430099Z   "organization_repositories_url": "https://api.github.com/orgs/{org}/repos{?type,page,per_page,sort}",
2021-05-14T04:16:44.7431292Z   "organization_teams_url": "https://api.github.com/orgs/{org}/teams",
2021-05-14T04:16:44.7432611Z   "public_gists_url": "https://api.github.com/gists/public",
2021-05-14T04:16:44.7434071Z   "rate_limit_url": "https://api.github.com/rate_limit",
2021-05-14T04:16:44.7435160Z   "repository_url": "https://api.github.com/repos/{owner}/{repo}",
2021-05-14T04:16:44.7436438Z   "repository_search_url": "https://api.github.com/search/repositories?q={query}{&page,per_page,sort,order}",
2021-05-14T04:16:44.7438697Z   "current_user_repositories_url": "https://api.github.com/user/repos{?type,page,per_page,sort}",
2021-05-14T04:16:44.7440606Z   "starred_url": "https://api.github.com/user/starred{/owner}{/repo}",
2021-05-14T04:16:44.7441839Z   "starred_gists_url": "https://api.github.com/gists/starred",
2021-05-14T04:16:44.7442830Z   "user_url": "https://api.github.com/users/{user}",
2021-05-14T04:16:44.7444050Z   "user_organizations_url": "https://api.github.com/user/orgs",
2021-05-14T04:16:44.7445260Z   "user_repositories_url": "https://api.github.com/users/{user}/repos{?type,page,per_page,sort}",
2021-05-14T04:16:44.7446574Z   "user_search_url": "https://api.github.com/search/users?q={query}{&page,per_page,sort,order}"
2021-05-14T04:16:44.7447750Z }
2021-05-14T04:16:44.7449399Z Installing Nix
2021-05-14T04:16:45.3710355Z downloading Nix 2.3.10 binary tarball for x86_64-linux from 'https://releases.nixos.org/nix/nix-2.3.10/nix-2.3.10-x86_64-linux.tar.xz' to '/tmp/nix-binary-tarball-unpack.LDlOssABRM'...
2021-05-14T04:16:45.3742182Z   % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
2021-05-14T04:16:45.3749190Z                                  Dload  Upload   Total   Spent    Left  Speed
2021-05-14T04:16:45.3752218Z 
2021-05-14T04:16:45.8556718Z   0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
2021-05-14T04:16:45.9924255Z  68 16.4M   68 11.2M    0     0  23.4M      0 --:--:-- --:--:-- --:--:-- 23.4M
2021-05-14T04:16:45.9926643Z 100 16.4M  100 16.4M    0     0  26.7M      0 --:--:-- --:--:-- --:--:-- 26.6M
2021-05-14T04:16:47.8164143Z Note: a multi-user installation is possible. See https://nixos.org/nix/manual/#sect-multi-user-installation
2021-05-14T04:16:47.8205995Z performing a single-user installation of Nix...
2021-05-14T04:16:47.8208931Z directory /nix does not exist; creating it by running 'mkdir -m 0755 /nix && chown runner /nix' using sudo
2021-05-14T04:16:48.1953517Z copying Nix to /nix/store......................................
2021-05-14T04:16:48.2924403Z installing 'nix-2.3.10'
2021-05-14T04:16:48.3067480Z building '/nix/store/3988ni0kzan1yl3n9a67vk470flgnqi2-user-environment.drv'...
2021-05-14T04:16:48.3070203Z created 6 symlinks in user environment
2021-05-14T04:16:50.0296179Z unpacking channels...
2021-05-14T04:16:54.7060979Z created 1 symlinks in user environment
2021-05-14T04:16:54.7853798Z modifying /home/runner/.bash_profile...
2021-05-14T04:16:54.7862890Z 
2021-05-14T04:16:54.7865038Z Installation finished!  To ensure that the necessary environment
2021-05-14T04:16:54.7866323Z variables are set, either log in again, or type
2021-05-14T04:16:54.7867232Z 
2021-05-14T04:16:54.7879765Z   . /home/runner/.nix-profile/etc/profile.d/nix.sh
2021-05-14T04:16:54.7883161Z 
2021-05-14T04:16:54.7949551Z in your shell.
2021-05-14T04:16:54.8390694Z Installing Nix - done
2021-05-14T04:16:54.8392169Z Installing dependencies
2021-05-14T04:16:55.7722558Z unpacking 'https://github.com/nmattia/niv/tarball/master'...
2021-05-14T04:17:00.0612720Z unpacking 'https://github.com/NixOS/nixpkgs/archive/ab8e2e46d9e0e7be3158b473c4b59fec8f79287b.tar.gz'...
2021-05-14T04:17:08.5993118Z installing 'niv-0.2.19'
2021-05-14T04:17:08.6045433Z trace: Warning: `stdenv.lib` is deprecated and will be removed in the next release. Please use `lib` instead. For more information see https://github.com/NixOS/nixpkgs/issues/108938
2021-05-14T04:17:11.1058753Z these paths will be fetched (1.30 MiB download, 6.22 MiB unpacked):
2021-05-14T04:17:11.1061142Z   /nix/store/dmi8q39sfrinkakswfxfhg0hiyk8cg7h-niv-0.2.19-data
2021-05-14T04:17:11.1064155Z   /nix/store/vv9ssrwmp6hj62w0l068f6fybp83zx5h-niv-0.2.19
2021-05-14T04:17:11.1071415Z don't know how to build these paths:
2021-05-14T04:17:11.1072523Z   /nix/store/16n426g6jbcwwdwlq7h7qmbv1v22p2v5-zlib-1.2.11
2021-05-14T04:17:11.1073903Z   /nix/store/83k1jk69mlzi8l9jajwnh0625fja94x0-gmp-6.2.1
2021-05-14T04:17:11.1075220Z   /nix/store/9ysrnpijf5yi6zvp22jfp96iw85m2nlb-libffi-3.3
2021-05-14T04:17:11.1077020Z   /nix/store/v8q6nxyppy1myi3rxni2080bv8s9jxiy-glibc-2.32-40
2021-05-14T04:17:11.1114941Z copying path '/nix/store/dmi8q39sfrinkakswfxfhg0hiyk8cg7h-niv-0.2.19-data' from 'https://niv.cachix.org'...
2021-05-14T04:17:31.4973170Z building '/nix/store/myfzvw3m2fzg7r3xkzr15c0flbc9mxiq-bash-4.4.tar.gz.drv'...
2021-05-14T04:19:00.4559050Z building '/nix/store/7x9q5qdd27aljvvrnrvabb6h6b0sh082-01-fix-ftbfs-with-glibc-2.28.patch.drv'...
2021-05-14T04:19:00.9604347Z building '/nix/store/f450ks5xaq790h43nc5r78x69cr4721q-Make-build-reproducible.patch.drv'...
2021-05-14T04:19:01.0279351Z building '/nix/store/2d6r2k56qfdsknp63q4f2hb9vgsn9bq7-Python-3.8.9.tar.xz.drv'...
2021-05-14T04:19:01.7489905Z building '/nix/store/hsk6nlgngj3isbckgxhrxr5w7948rvc0-acl-2.3.0.tar.gz.drv'...
2021-05-14T04:19:03.5041320Z building '/nix/store/2adm9mf4gs34vbn1js65v90yq6v9i12p-attr-2.4.48.tar.gz.drv'...
2021-05-14T04:19:03.6195902Z building '/nix/store/d4slmzl31mhi23fbnrclkd6cprl7c7gy-autoconf-2.70.tar.xz.drv'...
2021-05-14T04:19:05.2854338Z building '/nix/store/8fm1xkjq69i4a4ramgr14826zjmam2rh-automake-1.16.3.tar.xz.drv'...
2021-05-14T04:19:06.7562373Z building '/nix/store/c8svmxmwjkzvwszy8ga7x2fwx0qbmm10-bash44-001.drv'...
2021-05-14T04:19:06.8716256Z building '/nix/store/f30binazxhx8g0xkiav6lglp29h4a164-bash44-002.drv'...
2021-05-14T04:19:06.9890108Z building '/nix/store/q8hxz4f402ps0vwhj3sgfyp6x0ss35sv-bash44-003.drv'...
2021-05-14T04:19:07.1368516Z building '/nix/store/djmmx28jvbngp9wa15z4xasllaaqd1z0-bash44-004.drv'...
2021-05-14T04:19:07.2118830Z building '/nix/store/kpr5qx791p55y7kgbypw230nqp673fya-bash44-005.drv'...
2021-05-14T04:19:07.2727461Z building '/nix/store/ghyy9947nssi1vn8m6h0giik5sxgbvww-bash44-006.drv'...
…

Any ideas?

[knl]

Looking into it. Seems the issue stems from using the latest master from niv, which updated nixpkgs to the latest (3 days old) in https://github.com/nmattia/niv/commit/94080ae8286024820c570a2a24ed7c36d7ad04a9.

Could you try changing https://github.com/nomeata/kaleidogen/blob/master/.github/workflows/niv-updates.yml to include niv_version: 'af958e8057f345ee1aca714c1247ef3ba1c15f5e' and re-running? If that one goes well, I think we have the culprit.

[nomeata]

Applied, I’ll check tomorrow when the github cron job has triggered

[knl]

I also tried pinning Niv to the commit before last in one of my repos, and can confirm that there is no problem anymore. Now, off to figure out why the rebuild is needed.

[nomeata]

I didn’t get an error from github, forgot about it, but yes, that fixed it.