mikesmithgh / kitty-scrollback.nvim

😽 Open your Kitty scrollback buffer with Neovim. Ameowzing!
Apache License 2.0
421 stars 11 forks source link

test: track and fix flaky CI tests #228

Closed mikesmithgh closed 3 months ago

mikesmithgh commented 5 months ago

Failures

kitty_scrollback_config_demo_04_spec.lua

04/07/2024 plenary (stable, 0.32.2) kitty_scrollback_config_demo_04_spec.lua https://github.com/mikesmithgh/kitty-scrollback.nvim/actions/runs/8585749456/job/23527481200#logs Actual: ``` N▏ mple > --config ksb_example_paste_win_register_disabled ``` Expected: ``` N▏# example > --config ksb_example_paste_win_register_disabled ``` Most likely steps are too fast for CI and insert starts at the `a` character in `example`

(x2) kitty-scrollback.nvim should open scrollback buffer over ssh

04/11/2024 plenary (nightly, nightly) kitty_scrollback_linux_ci_spec.lua https://github.com/mikesmithgh/kitty-scrollback.nvim/actions/runs/8639464191/job/23685817654 ``` '$ rm -f ~/.ssh/id_ed25519_ci_test && ssh-keygen -t ed25519 -f ~/.ssh/id_ed25519_ci_test -N '' 󰄛 󰣐  Generating public/private ed25519 key pair. Created directory '/home/runner/.ssh'. Your identification has been saved in /home/runner/.ssh/id_ed25519_ci_test Your public key has been saved in /home/runner/.ssh/id_ed25519_ci_test.pub The key fingerprint is: SHA256:FH24knMqBamheiTc3CCff2FEc1uNPAMyHhbD44Nl+/A runner@fv-az1490-898 The key's randomart image is: +--[ED25519 256]--+ | o@o+ooo | | . .. =*B.==.. | |. =.+o*o+o oo | |..o=.o O= o | | + . ..S= | |. . ....E | | . .. | | | | | +----[SHA256]-----+ $ cat ~/.ssh/id_ed25519_ci_test.pub >> ~/.ssh/authorized_keys $ ssh -o "StrictHostKeyChecking no" -i ~/.ssh/id_ed25519_ci_test localhost TERM=xterm clear; \ [ Warning: Permanently added 'localhost' (ED25519) to the list of known hosts. - ' Expected: (string) 'You are connected via SSH. 󰄛 󰣐  ' ```

kitty-scrollback.nvim kitty_scrollback_nvim

04/12/2024 plenary (stable, nightly) kitty_scrollback_demo_spec.lua https://github.com/mikesmithgh/kitty-scrollback.nvim/actions/runs/8659643240/job/23745967551#step:11:307 ``` Passed in: (string) '$ git status On branch main Your branch is up to date with 'origin/main'. Changes not staged for commit: (use "git add ..." to update what will be committed) (use "git restore ..." to discard changes in working directory) modified: README.md modified: lua/kitty-scrollback/api.lua modified: lua/kitty-scrollback/health.lua modified: lua/kitty-scrollback/init.lua no changes added to commit (use "git add" and/or "git commit -a") $ DME.md git add jjj$yddggIgit checkout ...omitted Expected: (string) '$ git status On branch main Your branch is up to date with 'origin/main'. Changes not staged for commit: (use "git add ..." to update what will be committed) (use "git restore ..." to discard changes in working directory) modified: README.md modified: lua/kitty-scrollback/api.lua modified: lua/kitty-scrollback/health.lua modified: lua/kitty-scrollback/init.lua no changes added to commit (use "git add" and/or "git commit -a") $ git checkout README.md ```
mikesmithgh commented 5 months ago

235 reduced test matrix from 19 to 13, hopefully this improves reliability

mikesmithgh commented 3 months ago

Have not had flaky tests since reducing the combinations in the test matrix. Closing as I plan to further reduce the number of versions. Reopen if issues start again.