search

NixOS / hydra

Hydra, the Nix-based continuous build system
http://nixos.org/hydra
GNU General Public License v3.0
1.2k stars 307 forks source link

23.11 hydra compile error: 2 tests fail: hydra-create-user.t and hydra-init.t #1333

Closed qknight closed 10 months ago

qknight commented 10 months ago

Describe the bug I'm using nixos 23.11 on a dated t530 lenovo notebook with this configuration from the documentation:

services.hydra = {
  enable = true;
  hydraURL = "http://localhost:3000";
  notificationSender = "js@lastlog.de";
  buildMachinesFiles = [];
  useSubstitutes = true;
};
nix-channel --list
nixos https://nixos.org/channels/nixos-23.11

It needs to compile hydra, which usually should be a binary subsitute for reasons I don't understand.

( STDERR )  job 50      (in cleanup) {UNKNOWN}: DBI Exception: DBD::Pg::st DESTROY failed: no connection to the server [for Statement "SELECT me.project, me.jobset, me.name, me.type, me.emailresponsible FROM j
obsetinputs me WHERE ( ( me.jobset = ? AND me.project = ? ) )"]  at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Schema.pm line 1118.
( STDERR )  job 50      DBIx::Class::Schema::throw_exception(Hydra::Schema=HASH(0x7dd6e70), "DBI Exception: DBD::Pg::st DESTROY failed: no connection to t"...) called at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cn
xlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage.pm line 113
( STDERR )  job 50      DBIx::Class::Storage::throw_exception(DBIx::Class::Storage::DBI::Pg=HASH(0x7e4c3c0), "DBI Exception: DBD::Pg::st DESTROY failed: no connection to t"...) called at /nix/store/n0cm976fyqx
c4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage/DBI.pm line 1623
( STDERR )  job 50      DBIx::Class::Storage::DBI::__ANON__("DBD::Pg::st DESTROY failed: no connection to the server [for "..., DBI::st=HASH(0xabc97b8), undef) called at Hydra/Plugin/RunCommand/dynamic-disable
d.t line 0
( STDERR )  job 50      eval {...} called at Hydra/Plugin/RunCommand/dynamic-disabled.t line 0
( STDERR )  job 50    1:dynamic-enabled.t)
( PASSED )  job 50    Hydra/Plugin/RunCommand/dynamic-disabled.t
( PASSED )  job 51    Hydra/Plugin/RunCommand/dynamic-enabled.t
( PASSED )  job 53    Hydra/Plugin/RunCommand/fanout.t
( PASSED )  job 52    Hydra/Plugin/RunCommand/errno.t
( STDERR )  job 55      (in cleanup) {UNKNOWN}: DBI Exception: DBD::Pg::st DESTROY failed: no connection to the server [for Statement "SELECT me.build, me.name, me.path FROM buildoutputs me WHERE ( ( me.build
= ? AND me.name = ? ) )"]  at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Schema.pm line 1118.
( STDERR )  job 55      DBIx::Class::Schema::throw_exception(Hydra::Schema=HASH(0x4444fa8), "DBI Exception: DBD::Pg::st DESTROY failed: no connection to t"...) called at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cn
xlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage.pm line 113
( STDERR )  job 55      DBIx::Class::Storage::throw_exception(DBIx::Class::Storage::DBI::Pg=HASH(0x44aea40), "DBI Exception: DBD::Pg::st DESTROY failed: no connection to t"...) called at /nix/store/n0cm976fyqx
c4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage/DBI.pm line 1623
( STDERR )  job 55      DBIx::Class::Storage::DBI::__ANON__("DBD::Pg::st DESTROY failed: no connection to the server [for "..., DBI::st=HASH(0x4a19e18), undef) called at Hydra/Plugin/RunCommand/json.t line 0
( STDERR )  job 55      eval {...} called at Hydra/Plugin/RunCommand/json.t line 0
( STDERR )  job 55    m
( PASSED )  job 55    Hydra/Plugin/RunCommand/json.t
( PASSED )  job 56    Hydra/Plugin/RunCommand/matcher.t
( STDERR )  job 57    "my" variable $uri masks earlier declaration in same scope at Hydra/Plugin/gitea.t line 75.
( STDERR )  job 54      (in cleanup) {UNKNOWN}: DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminating connection due to administrator command
( STDERR )  job 54    server closed the connection unexpectedly
( STDERR )  job 54      This probably means the server terminated abnormally
( STDERR )  job 54      before or while processing the request. [for Statement "SELECT me.id, me.uuid, me.job_matcher, me.build_id, me.command, me.start_time, me.end_time, me.error_number, me.exit_code, me.sig
nal, me.core_dumped FROM runcommandlogs me WHERE ( me.uuid = ? )"]  at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Schema.pm line 1118.
( STDERR )  job 54      DBIx::Class::Schema::throw_exception(Hydra::Schema=HASH(0x7dd47e8), "DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminatin"...) called at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cn
xlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage.pm line 113
( STDERR )  job 54      DBIx::Class::Storage::throw_exception(DBIx::Class::Storage::DBI::Pg=HASH(0x7e3d098), "DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminatin"...) called at /nix/store/n0cm976fyqx
c4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage/DBI.pm line 1623
( STDERR )  job 54      DBIx::Class::Storage::DBI::__ANON__("DBD::Pg::st DESTROY failed: FATAL:  terminating connection du"..., DBI::st=HASH(0xaf44c90), undef) called at Hydra/Plugin/RunCommand/http.t line 0
( STDERR )  job 54      eval {...} called at Hydra/Plugin/RunCommand/http.t line 0
( STDERR )  job 54    0m
( PASSED )  job 54    Hydra/Plugin/RunCommand/http.t
( STDERR )  job 57    127.0.0.1 - - [04/Jan/2024 09:59:06] "POST /gitea/api/v1/repos/root/foo/statuses/e35a5db678eba268aee5d1d5e48bf5558157564c HTTP/1.1" 200 -
( PASSED )  job 57    Hydra/Plugin/gitea.t
( PASSED )  job 58    Hydra/PostgresListener.t
( PASSED )  job 60    Hydra/Schema/Result/TaskRetries.t
( PASSED )  job 59    Hydra/Schema/Result/RunCommandLogs.t
( PASSED )  job 61    Hydra/Schema/ResultSet/TaskRetries.t
( STDERR )  job 63    error running bogus-channel hooks: Failing plugin. at Hydra/TaskDispatcher.t line 55.
( STDERR )  job 63    er.t)
( STDERR )  job 63    error running bogus-channel hooks: Failing plugin. at Hydra/TaskDispatcher.t line 55.
( STDERR )  job 63    er.t)
( STDERR )  job 63    No plugin named this-plugin-does-not-exist
( STDERR )  job 63    error running fail-event hooks: Failing plugin. at Hydra/TaskDispatcher.t line 55.
( STDERR )  job 63    er.t)
( STDERR )  job 63    error running fail-event hooks: Failing plugin. at Hydra/TaskDispatcher.t line 55.
( STDERR )  job 63    er.t)
( STDERR )  job 63    error running fail-event hooks: Failing plugin. at Hydra/TaskDispatcher.t line 55.
( STDERR )  job 63    er.t)
( PASSED )  job 63    Hydra/TaskDispatcher.t
( PASSED )  job 64    Hydra/View/TT.t
( STDERR )  job 62      (in cleanup) {UNKNOWN}: DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminating connection due to administrator command
( STDERR )  job 62    server closed the connection unexpectedly
( STDERR )  job 62      This probably means the server terminated abnormally
( STDERR )  job 62      before or while processing the request. [for Statement "UPDATE users SET password = ? WHERE ( username = ? )"]  at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/
site_perl/5.38.0/DBIx/Class/Schema.pm line 1118.
( STDERR )  job 62      DBIx::Class::Schema::throw_exception(Hydra::Schema=HASH(0x434d3c8), "DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminatin"...) called at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cn
xlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage.pm line 113
( STDERR )  job 62      DBIx::Class::Storage::throw_exception(DBIx::Class::Storage::DBI::Pg=HASH(0x43ba1d0), "DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminatin"...) called at /nix/store/n0cm976fyqx
c4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage/DBI.pm line 1623
( STDERR )  job 62      DBIx::Class::Storage::DBI::__ANON__("DBD::Pg::st DESTROY failed: FATAL:  terminating connection du"..., DBI::st=HASH(0x48de8b0), undef) called at Hydra/Schema/Users.t line 0
( STDERR )  job 62      eval {...} called at Hydra/Schema/Users.t line 0
( STDERR )  job 62    t)
( STDERR )  job 62      (in cleanup) {UNKNOWN}: DBI Exception: DBD::Pg::st DESTROY failed: no connection to the server [for Statement "INSERT INTO users ( emailaddress, password, username) VALUES ( ?, ?, ? )"]
  at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Schema.pm line 1118.
( STDERR )  job 62      DBIx::Class::Schema::throw_exception(Hydra::Schema=HASH(0x434d3c8), "DBI Exception: DBD::Pg::st DESTROY failed: no connection to t"...) called at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cn
xlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage.pm line 113
( STDERR )  job 62      DBIx::Class::Storage::throw_exception(DBIx::Class::Storage::DBI::Pg=HASH(0x43ba1d0), "DBI Exception: DBD::Pg::st DESTROY failed: no connection to t"...) called at /nix/store/n0cm976fyqx
c4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage/DBI.pm line 1623
( STDERR )  job 62      DBIx::Class::Storage::DBI::__ANON__("DBD::Pg::st DESTROY failed: no connection to the server [for "..., DBI::st=HASH(0x487c090), undef) called at Hydra/Schema/Users.t line 0
( STDERR )  job 62      eval {...} called at Hydra/Schema/Users.t line 0
( STDERR )  job 62    t)
( PASSED )  job 62    Hydra/Schema/Users.t
( PASSED )  job 66    build-products.t
( STDERR )  job 65      (in cleanup) {UNKNOWN}: DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminating connection due to administrator command
( STDERR )  job 65    server closed the connection unexpectedly
( STDERR )  job 65      This probably means the server terminated abnormally
( STDERR )  job 65      before or while processing the request. [for Statement "SELECT me.id, me.finished, me.timestamp, me.jobset_id, me.job, me.nixname, me.description, me.drvpath, me.system, me.license, me.
homepage, me.maintainers, me.maxsilent, me.timeout, me.ischannel, me.iscurrent, me.priority, me.globalpriority, me.starttime, me.stoptime, me.iscachedbuild, me.buildstatus, me.size, me.closuresize, me.releasen
ame, me.keep, me.notificationpendingsince FROM builds me  JOIN jobsets jobset ON jobset.id = me.jobset_id  JOIN projects project ON project.name = jobset.project WHERE ( ( iscurrent = ? AND job ILIKE ? AND job
set.hidden = ? AND project.hidden = ? ) ) ORDER BY jobset.project, jobset.name, job LIMIT ?"]  at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Schema.pm lin
e 1118.
( STDERR )  job 65      DBIx::Class::Schema::throw_exception(Hydra::Schema=HASH(0x7dea060), "DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminatin"...) called at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cn
xlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage.pm line 113
( STDERR )  job 65      DBIx::Class::Storage::throw_exception(DBIx::Class::Storage::DBI::Pg=HASH(0x7e52c78), "DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminatin"...) called at /nix/store/n0cm976fyqx
c4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage/DBI.pm line 1623
( STDERR )  job 65      DBIx::Class::Storage::DBI::__ANON__("DBD::Pg::st DESTROY failed: FATAL:  terminating connection du"..., DBI::st=HASH(0xabfa418), undef) called at api-test.t line 0
( STDERR )  job 65      eval {...} called at api-test.t line 0
( STDERR )  job 65    te-basic.t)
( PASSED )  job 65    api-test.tm
( PASSED )  job 67    evaluator/evaluate-basic.t
( PASSED )  job 68    evaluator/evaluate-constituents-broken.t
( STDERR )  job 69    finding garbage collector roots...
( STDERR )  job 69    error: Cannot delete path '/build/yath-3699-J056YE/tmp/YR7qiE/dBFV4iXff_/nix/store/nl44iixc77w0qrs90m4ghydgb8xjfc1r-empty-dir-A.drv' since it is still alive. To find out why, use: nix-sto
re --query --roots
( STDERR )  job 69    finding garbage collector roots...
( STDERR )  job 69    error: Cannot delete path '/build/yath-3699-J056YE/tmp/YR7qiE/dBFV4iXff_/nix/store/s82bqz097ag6yyczmc6i0nkl6lx49y18-direct_aggregate.drv' since it is still alive. To find out why, use: ni
x-store --query --roots
( STDERR )  job 69    finding garbage collector roots...
( STDERR )  job 69    error: Cannot delete path '/build/yath-3699-J056YE/tmp/YR7qiE/dBFV4iXff_/nix/store/62axxpycms093nnwkyc9xfq6fwqnfrvn-indirect_aggregate.drv' since it is still alive. To find out why, use:
nix-store --query --roots
( PASSED )  job 69    evaluator/evaluate-constituents-gc.t
( SKIPPED)  job 71    evaluator/evaluate-oom-job.t  -  `systemd-run` failed when invoked in this environment
( PASSED )  job 70    evaluator/evaluate-dependent-jobsets.t
( PASSED )  job 72    input-types/bzr-checkout.t
( PASSED )  job 73    input-types/bzr.t
( PASSED )  job 74    input-types/darcs.t
( PASSED )  job 76    input-types/git-rev.t
( PASSED )  job 75    input-types/deepgit.t
( PASSED )  job 78    input-types/hg.t
( PASSED )  job 77    input-types/git.t
( PASSED )  job 79    input-types/svn-checkout.t
( PASSED )  job 80    input-types/svn.t
( PASSED )  job 82    queue-runner/constituents.t
( PASSED )  job 81    queue-runner/build-locally-with-substitutable-path.t
( PASSED )  job 83    queue-runner/default-machine-file.t
( PASSED )  job 84    queue-runner/direct-indirect-constituents.t
( STDERR )  job 85    this derivation will be built:
( STDERR )  job 85      /build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/rhk7vm5snqp835yvdka5garcd5vzx80w-can-be-substituted.drv
( STDERR )  job 85    building '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/rhk7vm5snqp835yvdka5garcd5vzx80w-can-be-substituted.drv'...
( STDERR )  job 85    some outputuser.t)
( STDERR )  job 85    warning: you don't have Internet access; disabling some network-dependent features
( STDERR )  job 85    copying 1 paths...
( STDERR )  job 85    copying path '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/f5nvy2fcvsrpdj342wg2wi7m5a2c7qk3-can-be-substituted' to 'file:///build/yath-3699-J056YE/tmp/leGwQK/dBFV4iXff_'...
( STDERR )  job 85    warning: you don't have Internet access; disabling some network-dependent features
( STDERR )  job 85    got build log for '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/f5nvy2fcvsrpdj342wg2wi7m5a2c7qk3-can-be-substituted' from 'local'
( STDERR )  job 85    finding garbage collector roots...
( STDERR )  job 85    removing stale link from '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/var/nix/gcroots/auto/fqldhfqlykrhjj24r385xps4p77z2gvi' to '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/basic-
canbesubstituted'
( STDERR )  job 85    deleting '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/f5nvy2fcvsrpdj342wg2wi7m5a2c7qk3-can-be-substituted'
( STDERR )  job 85    deleting unused links...
( STDERR )  job 85    note: currently hard linking saves -0.00 MiB
( STDERR )  job 85    finding garbage collector roots...
( STDERR )  job 85    deleting garbage...[0m
( STDERR )  job 85    deleting '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/rhk7vm5snqp835yvdka5garcd5vzx80w-can-be-substituted.drv'
( STDERR )  job 85    deleting '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/62h9dv5fvdkvba26czkypfw0hpbsdrlc-empty-dir-builder.sh'
( STDERR )  job 85    deleting unused links...
( STDERR )  job 85    note: currently hard linking saves -0.00 MiB
( STDERR )  job 85    this path will be fetched (0.00 MiB download, 0.00 MiB unpacked):
( STDERR )  job 85      /build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/f5nvy2fcvsrpdj342wg2wi7m5a2c7qk3-can-be-substituted
( STDERR )  job 85    copying path '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/f5nvy2fcvsrpdj342wg2wi7m5a2c7qk3-can-be-substituted' from 'file:///build/yath-3699-J056YE/tmp/leGwQK/dBFV4iXff_'...
( STDERR )  job 85    warning: you don't have Internet access; disabling some network-dependent features
( STDERR )  job 85    error: build log of '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/f5nvy2fcvsrpdj342wg2wi7m5a2c7qk3-can-be-substituted' is not available
( STDERR )  job 85    finding garbage collector roots...
( STDERR )  job 85    removing stale link from '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/var/nix/gcroots/auto/fqldhfqlykrhjj24r385xps4p77z2gvi' to '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/basic-
canbesubstituted'
( STDERR )  job 85    deleting '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/f5nvy2fcvsrpdj342wg2wi7m5a2c7qk3-can-be-substituted'
( STDERR )  job 85    deleting unused links...
( STDERR )  job 85    note: currently hard linking saves -0.00 MiB
( STDERR )  job 85    finding garbage collector roots...
( STDERR )  job 85    deleting garbage...[0m
( STDERR )  job 85    deleting '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/rhk7vm5snqp835yvdka5garcd5vzx80w-can-be-substituted.drv'
( STDERR )  job 85    deleting '/build/yath-3699-J056YE/tmp/leGwQK/gRmB03vkxL/nix/store/62h9dv5fvdkvba26czkypfw0hpbsdrlc-empty-dir-builder.sh'
( STDERR )  job 85    deleting unused links...
( STDERR )  job 85    note: currently hard linking saves -0.00 MiB
( PASSED )  job 85    queue-runner/notifications.t
[  FAIL  ]  job 86  +~Handling password and password hash creation
< REASON >  job 86    Subtest failures were encountered (Count: 3)
[  FAIL  ]  job 86    +~Creating a user with a plain text password (insecure) stores the password securely
< REASON >  job 86    | No plan was declared
[  FAIL  ]  job 86    | + hydra-create-user should exit zero
[  DEBUG ]  job 86    | | scripts/hydra-create-user.t line 13
(  DIAG  )  job 86    | | +-----+----+-------+
(  DIAG  )  job 86    | | | GOT | OP | CHECK |
(  DIAG  )  job 86    | | +-----+----+-------+
(  DIAG  )  job 86    | | | -1  | eq | 0     |
(  DIAG  )  job 86    | | +-----+----+-------+
[  FAIL  ]  job 86    | + The user exists
(  DIAG  )  job 86    | | Failed test 'The user exists'
(  DIAG  )  job 86    | | at scripts/hydra-create-user.t line 17.
(  DIAG  )  job 86    | | Comparison matched (it should not).
            job 86    | ^
(  DIAG  )  job 86    | ----- START -----
Failed test 'Creating a user with a plain text password (insecure) stores the password securely'
at scripts/hydra-create-user.t line 23.
(  DIAG  )  job 86    | ------ END ------
(  DIAG  )  job 86    | Caught exception in subtest: Can't call method "password" on an undefined value at scripts/hydra-create-user.t line 18.
[  FAIL  ]  job 86    +~Creating a user with a sha1 password (still insecure) stores the password as a hashed sha1
< REASON >  job 86    | No plan was declared
[  FAIL  ]  job 86    | + hydra-create-user should exit zero
[  DEBUG ]  job 86    | | scripts/hydra-create-user.t line 27
(  DIAG  )  job 86    | | +-----+----+-------+
(  DIAG  )  job 86    | | | GOT | OP | CHECK |
(  DIAG  )  job 86    | | +-----+----+-------+
(  DIAG  )  job 86    | | | -1  | eq | 0     |
(  DIAG  )  job 86    | | +-----+----+-------+
[  FAIL  ]  job 86    | + The user exists
(  DIAG  )  job 86    | | Failed test 'The user exists'
(  DIAG  )  job 86    | | at scripts/hydra-create-user.t line 30.
(  DIAG  )  job 86    | | Comparison matched (it should not).
            job 86    | ^
(  DIAG  )  job 86    | ----- START -----
Failed test 'Creating a user with a sha1 password (still insecure) stores the password as a hashed sha1'
at scripts/hydra-create-user.t line 36.
(  DIAG  )  job 86    | ------ END ------
(  DIAG  )  job 86    | Caught exception in subtest: Can't call method "password" on an undefined value at scripts/hydra-create-user.t line 31.
[  FAIL  ]  job 86    +~Creating a user by prompting for the password
< REASON >  job 86    | Subtest failures were encountered (Count: 1)
[  FAIL  ]  job 86    | +~with the same password twice
< REASON >  job 86    | | No plan was declared
[  FAIL  ]  job 86    | | + hydra-create-user should exit zero
[  DEBUG ]  job 86    | | | scripts/hydra-create-user.t line 54
(  DIAG  )  job 86    | | | +-----+----+-------+
(  DIAG  )  job 86    | | | | GOT | OP | CHECK |
(  DIAG  )  job 86    | | | +-----+----+-------+
(  DIAG  )  job 86    | | | | -1  | eq | 0     |
(  DIAG  )  job 86    | | | +-----+----+-------+
[  FAIL  ]  job 86    | | + The user exists
(  DIAG  )  job 86    | | | ----- START -----
Failed test 'The user exists'
at scripts/hydra-create-user.t line 57.
(  DIAG  )  job 86    | | | ------ END ------
(  DIAG  )  job 86    | | | Comparison matched (it should not).
            job 86    | | ^
(  DIAG  )  job 86    | | ----- START -----
Failed test 'with the same password twice'
at scripts/hydra-create-user.t line 62.
(  DIAG  )  job 86    | | ------ END ------
(  DIAG  )  job 86    | | Caught exception in subtest: Can't call method "password" on an undefined value at scripts/hydra-create-user.t line 58.
            job 86    | ^
(  DIAG  )  job 86    | ----- START -----
Failed test 'Creating a user by prompting for the password'
at scripts/hydra-create-user.t line 68.
(  DIAG  )  job 86    | ------ END ------
            job 86    ^
(  DIAG  )  job 86    ----- START -----
Failed test 'Handling password and password hash creation'
at scripts/hydra-create-user.t line 91.
(  DIAG  )  job 86    ------ END ------
(  DIAG  )  job 86    Seeded srand with seed '20240104' from local date.
( FAILED )  job 86    scripts/hydra-create-user.t
< REASON >  job 86    Test script returned error (Err: 1)
< REASON >  job 86    Errors were encountered (Count: 1)
< REASON >  job 86    Assertion failures were encountered (Count: 1)
< REASON >  job 86    Subtest failures were encountered (Count: 1)
( PASSED )  job 87    scripts/hydra-eval-jobset/notifications.t
( PASSED )  job 89    scripts/hydra-send-stats.t
[  FAIL  ]  job 88  +~hydra-init upgrades user's password hashes from sha1 to sha1 inside Argon2
< REASON >  job 88    Subtest failures were encountered (Count: 1)
[  FAIL  ]  job 88    + <UNNAMED ASSERTION>
[  DEBUG ]  job 88    | scripts/hydra-init.t line 34
(  DIAG  )  job 88    | ----- START -----
+--------------------------------------+----+-------+
| GOT                                  | OP | CHECK |
+--------------------------------------+----+-------+
| upgrading user passwords from sha1\n | eq |       |
|  * alice\n                           |    |       |
| timeout\n                            |    |       |
+--------------------------------------+----+-------+
(  DIAG  )  job 88    | ------ END ------
[  FAIL  ]  job 88    + hydra-init should exit zero
[  DEBUG ]  job 88    | scripts/hydra-init.t line 36
(  DIAG  )  job 88    | +-----+----+-------+
(  DIAG  )  job 88    | | GOT | OP | CHECK |
(  DIAG  )  job 88    | +-----+----+-------+
(  DIAG  )  job 88    | | -1  | eq | 0     |
(  DIAG  )  job 88    | +-----+----+-------+
[  FAIL  ]  job 88    +~Alice had their password updated in place
[  FAIL  ]  job 88    | + The password was updated in place.
(  DIAG  )  job 88    | | ----- START -----
Failed test 'The password was updated in place.'
at scripts/hydra-init.t line 41.
(  DIAG  )  job 88    | | ------ END ------
(  DIAG  )  job 88    | | Comparison matched (it should not).
            job 88    | ^
(  DIAG  )  job 88    | ----- START -----
Failed test 'Alice had their password updated in place'
at scripts/hydra-init.t line 46.
(  DIAG  )  job 88    | ------ END ------
            job 88    ^
(  DIAG  )  job 88    ----- START -----
Failed test 'hydra-init upgrades user's password hashes from sha1 to sha1 inside Argon2'
at scripts/hydra-init.t line 68.
(  DIAG  )  job 88    ------ END ------
(  DIAG  )  job 88    Seeded srand with seed '20240104' from local date.
( STDERR )  job 88      (in cleanup) {UNKNOWN}: DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminating connection due to administrator command
( STDERR )  job 88    server closed the connection unexpectedly
( STDERR )  job 88      This probably means the server terminated abnormally
( STDERR )  job 88      before or while processing the request. [for Statement "SELECT me.username, me.fullname, me.emailaddress, me.password, me.emailonerror, me.type, me.publicdashboard FROM users me WHERE (
 me.username = ? )"]  at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Schema.pm line 1118.
( STDERR )  job 88      DBIx::Class::Schema::throw_exception(Hydra::Schema=HASH(0x4310d10), "DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminatin"...) called at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cn
xlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage.pm line 113
( STDERR )  job 88      DBIx::Class::Storage::throw_exception(DBIx::Class::Storage::DBI::Pg=HASH(0x43d1b90), "DBI Exception: DBD::Pg::st DESTROY failed: FATAL:  terminatin"...) called at /nix/store/n0cm976fyqx
c4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage/DBI.pm line 1623
( STDERR )  job 88      DBIx::Class::Storage::DBI::__ANON__("DBD::Pg::st DESTROY failed: FATAL:  terminating connection du"..., DBI::st=HASH(0x490c008), undef) called at scripts/hydra-init.t line 0
( STDERR )  job 88      eval {...} called at scripts/hydra-init.t line 0
( STDERR )  job 88    e-gc-roots.t)
( STDERR )  job 88      (in cleanup) {UNKNOWN}: DBI Exception: DBD::Pg::st DESTROY failed: no connection to the server [for Statement "UPDATE users SET password = ? WHERE ( username = ? )"]  at /nix/store/n0cm
976fyqxc4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Schema.pm line 1118.
( STDERR )  job 88      DBIx::Class::Schema::throw_exception(Hydra::Schema=HASH(0x4310d10), "DBI Exception: DBD::Pg::st DESTROY failed: no connection to t"...) called at /nix/store/n0cm976fyqxc4l3gcb8sp940z5cn
xlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage.pm line 113
( STDERR )  job 88      DBIx::Class::Storage::throw_exception(DBIx::Class::Storage::DBI::Pg=HASH(0x43d1b90), "DBI Exception: DBD::Pg::st DESTROY failed: no connection to t"...) called at /nix/store/n0cm976fyqx
c4l3gcb8sp940z5cnxlgp-hydra-perl-deps/lib/perl5/site_perl/5.38.0/DBIx/Class/Storage/DBI.pm line 1623
( STDERR )  job 88      DBIx::Class::Storage::DBI::__ANON__("DBD::Pg::st DESTROY failed: no connection to the server [for "..., DBI::st=HASH(0x48ed858), undef) called at scripts/hydra-init.t line 0
( STDERR )  job 88      eval {...} called at scripts/hydra-init.t line 0
( STDERR )  job 88    e-gc-roots.t)
( FAILED )  job 88    scripts/hydra-init.t
< REASON >  job 88    Test script returned error (Err: 1)
< REASON >  job 88    Errors were encountered (Count: 1)
< REASON >  job 88    Assertion failures were encountered (Count: 1)
< REASON >  job 88    Subtest failures were encountered (Count: 1)
( PASSED )  job 90    scripts/hydra-update-gc-roots/update-gc-roots.t
32mP:88|F:2|R:0|T:0] Events: 2958
The following jobs failed:
+------------------------+------------------------+------------------------+
| Job ID                 | Test File              | Subtests               |
+------------------------+------------------------+------------------------+
| 4BD88020-AAE6-11EE-808 | scripts/hydra-create-u | Handling password and  |
| 9-E7910E8479EE         | ser.t                  | password hash creation |
|                        |                        | Handling password and  |
|                        |                        | password hash creation |
|                        |                        |  -> Creating a user wi |
|                        |                        | th a plain text passwo |
|                        |                        | rd (insecure) stores t |
|                        |                        | he password securely   |
|                        |                        | Handling password and  |
|                        |                        | password hash creation |
|                        |                        |  -> Creating a user wi |
|                        |                        | th a sha1 password (st |
|                        |                        | ill insecure) stores t |
|                        |                        | he password as a hashe |
|                        |                        | d sha1                 |
|                        |                        | Handling password and  |
|                        |                        | password hash creation |
|                        |                        |  -> Creating a user by |
|                        |                        |  prompting for the pas |
|                        |                        | sword                  |
|                        |                        | Handling password and  |
|                        |                        | password hash creation |
|                        |                        |  -> Creating a user by |
|                        |                        |  prompting for the pas |
|                        |                        | sword -> with the same |
|                        |                        |  password twice        |
|                        |                        |                        |
| 4BD8A44C-AAE6-11EE-808 | scripts/hydra-init.t   | hydra-init upgrades us |
| 9-E7910E8479EE         |                        | er's password hashes f |
|                        |                        | rom sha1 to sha1 insid |
|                        |                        | e Argon2               |
|                        |                        | hydra-init upgrades us |
|                        |                        | er's password hashes f |
|                        |                        | rom sha1 to sha1 insid |
|                        |                        | e Argon2 -> Alice had  |
|                        |                        | their password updated |
|                        |                        |  in place              |
+------------------------+------------------------+------------------------+

                                    Yath Result Summary
-------------------------------------------------------------------------------------------
     Fail Count: 2
     File Count: 90
Assertion Count: 1392
      Wall Time: 1121.04 seconds
       CPU Time: 2138.57 seconds (usr: 7.50s | sys: 1.38s | cusr: 1774.83s | csys: 354.86s)
      CPU Usage: 190%
    -->  Result: FAILED  <--

1..1
not ok 1 - Passed tests when run by yath
yath exited with 256FAIL: test.pl
===================
1 of 2 tests failed
===================
make[2]: *** [Makefile:354: check-TESTS] Error 1
make[2]: Leaving directory '/build/source/t'
make[1]: *** [Makefile:480: check-am] Error 2
make[1]: Leaving directory '/build/source/t'
make: *** [Makefile:422: check-recursive] Error 1
error: builder for '/nix/store/f6lfb5617dfr245a7y1da7dqw9s8sa88-hydra-2023-11-17.drv' failed with exit code 2
error: 1 dependencies of derivation '/nix/store/7yylrncz0l8f55fb5sijiwllrara3q6m-hydra-env.drv' failed to build
error: 1 dependencies of derivation '/nix/store/wr1ii3ayjh97mcnkf2bxrcwmlqac5g8y-system-path.drv' failed to build
error: 1 dependencies of derivation '/nix/store/cswg50ziw719mcxag9blys3falv733fk-unit-hydra-evaluator.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/rn4d3a8gpmc2g3wpdxxrxzv4ckrx0isv-unit-hydra-init.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/f72v3qwjf2qshlan4y7yrg17wgd7sbv8-unit-hydra-notify.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/k60zm2kj4b6blbxymp8fl3y8ghzzpc9h-unit-hydra-queue-runner.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/mshdgaln08sx833r7i6jbf46fmnsqkzj-unit-hydra-send-stats.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/kd0cxsdgxqf1sc9q7y5db3ag5ijla6pi-unit-hydra-server.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/iqp5yypw0qj47r8fx6mkxw1p8gawyycx-unit-hydra-update-gc-roots.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/sh5zf3fhis12z7rkpdw76f3nl9j5pvj5-X-Restart-Triggers-polkit.drv' failed to build
error: 1 dependencies of derivation '/nix/store/vyhm6g7avci378d77bw8l65rn747mqfs-dbus-1.drv' failed to build
error: 1 dependencies of derivation '/nix/store/fgi4378a7744s7ccgrkfa6bx2qwcqv7n-X-Restart-Triggers-dbus.drv' failed to build
error: 1 dependencies of derivation '/nix/store/kymly0a3r1riqnfbqdm7ckkrka0d05yy-unit-polkit.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/629fyzc76pavl8pdzarag6s50l5yygxj-unit-dbus.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/k89nrssx2wm8y5f1y7bb4fy7x2zhwarm-unit-dbus.service.drv' failed to build
error: 9 dependencies of derivation '/nix/store/iiahdavgqfxlhslvv7dgr6rm6w2mdh73-system-units.drv' failed to build
error: 1 dependencies of derivation '/nix/store/ya6pv5657bz02k62j8hwq37wcwxhqn8p-user-units.drv' failed to build
error: 4 dependencies of derivation '/nix/store/jd63rxvbn1bqbl7b9130d78hn0b58srr-etc.drv' failed to build
error: 2 dependencies of derivation '/nix/store/xrfqr78pq4zs29p3kgy56d65qha6h1ks-nixos-system-nixos-thinkpad-t530-23.11.2451.2d2ea8eab9e4.drv' failed to build

To Reproduce Don't know how.

Expected behavior I expected that hydra subsitute would be downloaded and hydra would be started on my NixOS 23.11 installation.

Hydra Server:

Please fill out this data as well as you can, but don't worry if you can't -- just do your best.

Ma27 commented 10 months ago

I assume that this is the NixOS module and Hydra package from nixpkgs?

In fact, I could reproduce this issue on my Hydra fork, but merging in Hydra master fixed the issue. The following merge did the trick: https://github.com/Ma27/hydra/commit/cfcd6b6d5a099776a45a7eca06f4534edfe9aa7f

I assume that https://github.com/Ma27/hydra/commit/cfcd6b6d5a099776a45a7eca06f4534edfe9aa7f#diff-8e49a5c05bb74b6d179f6a5568f4e22334dd24bec14495ea4052c4e01146d916 is related.

Anyways, if that's the case then this is a nixpkgs bug because the Hydra "version" is too old.

qknight commented 10 months ago

@Ma27 so far I can't get the version you pointed out to run:

  nixpkgs.overlays = [(final: prev:  {
    hydra_unstable = prev.hydra_unstable.overrideAttrs {
      src = pkgs.fetchFromGitHub {
        owner = "NixOS";
        repo = "hydra";
        rev = "cfcd6b6d5a099776a45a7eca06f4534edfe9aa7f";
        hash = "sha256-6jUNlUr67snI3WijkVZcODxkjT/UxeqC3z0CQY4hrfs=";
      };
    };
    }
  )];

Fails with:

config.status: executing executable-scripts commands
building
build flags: -j2 SHELL=/nix/store/q1c2flcykgr4wwg5a6h450hxbk4ch589-bash-5.2-p15/bin/bash
make  all-recursive
make[1]: Entering directory '/build/source'
Making all in src
make[2]: Entering directory '/build/source/src'
Making all in hydra-evaluator
make[3]: Entering directory '/build/source/src/hydra-evaluator'
g++ -DHAVE_CONFIG_H -I. -I../..    -std=c++2a -I/nix/store/2iqsv9phqnxl4vqgcci7plr2v7c3k6y8-nix-2.17.1-dev/include/nix -I/nix/store/xyhqn7mhfkzkx58dw74xlxi5fx765df9-boehm-gc-8.2.2-dev/include -Wall -I ../libhydra -Wno-deprecated-declarations -g -O2 -include nix/config.h -c -o hydra_evaluator-hydra-evaluator.o `test -f 'hydra-evaluator.cc' || echo './'`hydra-evaluator.cc
In file included from hydra-evaluator.cc:1:
../libhydra/db.hh:5:10: fatal error: environment-variables.hh: No such file or directory
    5 | #include "environment-variables.hh"
      |          ^~~~~~~~~~~~~~~~~~~~~~~~~~
compilation terminated.
make[3]: *** [Makefile:443: hydra_evaluator-hydra-evaluator.o] Error 1
make[3]: Leaving directory '/build/source/src/hydra-evaluator'
make[2]: *** [Makefile:363: all-recursive] Error 1
make[2]: Leaving directory '/build/source/src'
make[1]: *** [Makefile:422: all-recursive] Error 1
make[1]: Leaving directory '/build/source'
make: *** [Makefile:350: all] Error 2
error: builder for '/nix/store/y4hdffacnqkrax8pj21sgz0wkl9anhzv-hydra-2023-11-17.drv' failed with exit code 2
error: 1 dependencies of derivation '/nix/store/m3jr6l9pkmdapkjqarzjiiwvp8iwyn9x-hydra-env.drv' failed to build
error: 1 dependencies of derivation '/nix/store/6q584dq7x8ipnvx9zs4gr7r74zj4y9fb-system-path.drv' failed to build
error: 1 dependencies of derivation '/nix/store/bk6z1lmdpkhdibn2inpjg41an50fi8dq-unit-hydra-evaluator.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/v73pydz30jb8gqmbmnzv7x04xczv54q3-unit-hydra-init.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/93nyimzg3l9gzj5d9vxkhxqv784v2vr5-unit-hydra-notify.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/5v59jr6qij0d9sachhg2a9nkmz2a7xdc-unit-hydra-queue-runner.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/zp4ifspcqhv5g60p7ydlwvb58sc14415-unit-hydra-send-stats.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/31xrhnzm5hh7fi05y0p3xm33gzxnr3qc-unit-hydra-server.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/kpzhvdw5ibsgm6hhq0dsp1shv8gdd83m-unit-hydra-update-gc-roots.service.drv' failed to build
error: 1 dependencies of derivation '/nix/store/gvrayyc9ayfgrrr63vpwzg2wi47gw33x-nixos-system-nixos-thinkpad-t530-23.11.2451.2d2ea8eab9e4.drv' failed to build

How to use hydra then? Should I use the hydra flake instead?

Ma27 commented 10 months ago

Fails with:

Oh sorry I forgot to mention that (because I had the exact same error as well on my upgrade journey). That's because the Hydra master is only compatible with the API from Nix 2.19. I built Hydra against 2.19 and then it worked fine for me.

How to use hydra then? Should I use the hydra flake instead?

That's what I'm doing these days.

Alternatively, Hydra on nixpkgs master seems to build fine, so you may want to request a backport to 23.11 for it (it'll also need 2.19 most likely, but I took care of that backport already in https://github.com/NixOS/nixpkgs/pull/279184#pullrequestreview-1807498750).

EDIT: upon taking a closer look I just realized that I can build /nix/store/f6lfb5617dfr245a7y1da7dqw9s8sa88-hydra-2023-11-17.drv just fine now oO I must say I'm a little confused now.

qknight commented 10 months ago

I can't imagine that on nixpkgs 23.11 release, the hydra in nixpkgs would have been released while still failing.

I update the nix-channel once more but still can't build it.

qknight commented 10 months ago

@Ma27 If you backport nix 2.19, this also means that we have to rebuild basically the complete OS, right? Or are you only using a different version for hydra then?

Something else I was considering, maybe we can get a previous version going instead, what do you think?

qknight commented 10 months ago

With nix 2.19 and the https://github.com/Ma27/hydra/commit/cfcd6b6d5a099776a45a7eca06f4534edfe9aa7f I get this now:

all fail

could this be a race condition because my machine is slow?!

nix and hydra updates


{ config, pkgs, lib, callPackage, ... }:
{
  nixpkgs.overlays = [(final: prev:  {
    # cp -r pkgs/tools/package-management/nix/* /etc/nixos/nix
    # extend with nix_2_19
    #  nix_2_19 = prev.nix.common {
    #    version = "2.19.2";
    #    hash = "sha256-iA8DqS+W2fWTfR+nNJSvMHqQ+4NpYMRT3b+2zS6JTvE=";
    #  };

    nixVersions = lib.recurseIntoAttrs (pkgs.callPackage /etc/nixos/nix {
      storeDir = config.nix.storeDir or "/nix/store";
      stateDir = config.nix.stateDir or "/nix/var";
      inherit (prev.darwin.apple_sdk.frameworks) Security;
    });
    # nixos/modules/services/continuous-integration/hydra/default.nix
    hydra_unstable_2_19 = final.hydra_unstable_cfcd.override { nix = final.nixVersions.nix_2_19; };
    hydra_unstable_cfcd = prev.hydra_unstable.overrideAttrs {
      src = pkgs.fetchFromGitHub {
        owner = "NixOS";
        repo = "hydra";
        rev = "cfcd6b6d5a099776a45a7eca06f4534edfe9aa7f";
        hash = "sha256-6jUNlUr67snI3WijkVZcODxkjT/UxeqC3z0CQY4hrfs=";
      };
    };
    }
  )];

And for the service

 services.hydra = {
    enable = true;
    hydraURL = "http://localhost:3000";
    notificationSender = "js@lastlog.de";
    buildMachinesFiles = [];
    useSubstitutes = true;
    package = pkgs.hydra_unstable_2_19;
  };

It was really hard to figure out how to get override/overrideAttrs work in conjunction and how to copy the nix source code so i can add the 2.19 version.

qknight commented 10 months ago

@Ma27 thanks for your help. I updated to nixos-unstable now.

Ma27 commented 10 months ago

If you backport nix 2.19, this also means that we have to rebuild basically the complete OS, right?

The default Nix version won't be touched on a stable release. And even if that'd be the case, that won't cause a full rebuild, not every package depends on Nix.

could this be a race condition because my machine is slow?!

Yes, a few other tests are racy. That's why I usually hit restart when building Hydra on my Hydra for a few times 😅 The failure above was new and reproducible even on my laptop (the other errors usually happen on my builders with a few mroe cores).

It's kinda unfortunate that we don't exactly know what's up there, right? The .drv you provided above was buildable for me even though I could reliably reproduce the errors on my own fork. I don't really have the time right now to dive into it, but I guess that should be fine given that it's buildable for you now :)