juspay / services-flake

NixOS-like services for Nix flakes
https://community.flake.parts/services-flake
MIT License
299 stars 28 forks source link

ci: Switch to self-hosted runner #226

Closed srid closed 1 month ago

srid commented 1 month ago

Proudly hosted by @juspay !

Infra PR https://github.com/juspay/nixos-buffet/pull/13

Much simplifies our workflow:

image

And we get to use the builtin Nix system names directly in the workflow:

image
srid commented 1 month ago

@shivaraj-bh Getting a bunch of this in CI (our mac studio):

image
srid commented 1 month ago

Still running over 1.5 hours ... currently at apache-kafka-test

https://github.com/juspay/services-flake/actions/runs/9507348769/job/26206611624

EDIT: I'm cancelling and restarting it.

shivaraj-bh commented 1 month ago

Still running over 1.5 hours ... currently at apache-kafka-test

https://github.com/juspay/services-flake/actions/runs/9507348769/job/26206611624

EDIT: I'm cancelling and restarting it.

I believe we might need wait_for_open_port(<port_num>), like in nixos modules: https://github.com/NixOS/nixpkgs/blob/3b3f81db169561308698b5dc0d92a03a802f4002/nixos/tests/open-webui.nix#L29C5-L29C44

srid commented 1 month ago

Added a Linux runner, but mysql-test failed:

https://github.com/juspay/services-flake/actions/runs/9520309446/job/26245492894

mysql-test> [test       ] ERROR 1045 (28000): Access denied for user 'nixbld'@'localhost' (using password: NO)
srid commented 1 month ago

I believe we might need wait_for_open_port(<port_num>), like in nixos modules: https://github.com/NixOS/nixpkgs/blob/3b3f81db169561308698b5dc0d92a03a802f4002/nixos/tests/open-webui.nix#L29C5-L29C44

The darwin build worked now. So looks to be a transient issue 🤷🏿

EDIT: The linux build has also worked!

srid commented 1 month ago

All passes, except the llm example fails to build on rosetta:

       error: Package ‘python3.11-jaxlib-0.4.28’ in /nix/store/63lvc59rjz075kb1f11xww2x2xqpw1pn-source/pkgs/development/python-modules/jaxlib/bin.nix:228 is marked as broken, refusing to evaluate.

Note that the CI for main branch no longer builds on Intel mac, as macos-latest is now an alias for macos-14

https://docs.github.com/en/actions/using-github-hosted-runners/about-github-hosted-runners/about-github-hosted-runners

image

I'll comment out rosetta and file a new issue for it.

srid commented 1 month ago

Need to address github rate limits. That's the only thing to do before merging this PR.