CI Failure (gtest_raft_rpunit fails with last visible offset can not be larger than log end offset) in `Class.method`

[travisdowns]

https://buildkite.com/redpanda/vtools/builds/11780#018d8c89-dcc9-46df-beef-61e9a5137fa2

This is a unit test failure in gtest_raft_rpunit which occurred on an unrelated PR that only changed a python script. Presumably the test is flaky.

2024-02-09 05:18:08 CST ERROR 2024-02-09 08:14:11,118 [shard 0:main] assert - Assert failure: (/var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-00bc458ca0fa1a020-1/redpanda/vtools/src/v/raft/tests/basic_raft_fixture_test.cc:306) 'o <= node->raft()->dirty_offset()' last visible offset can not be larger than log end offset
2024-02-09 05:18:08 CST ERROR 2024-02-09 08:14:11,118 [shard 0:main] assert - Backtrace below:
2024-02-09 05:18:08 CST 0x1f6c8f3 0x9d57a1 0x9d5ae7 0x1cd285f 0x1cd5fd1 0x1cd3166 0x1bf00a0 0x1bee498 0x1bbf2ad 0x1c8829f /lib64/libc.so.6+0x91016 /lib64/libc.so.6+0x1166cf
2024-02-09 05:18:08 CST    --------
2024-02-09 05:18:08 CST    seastar::internal::do_until_state<raft_fixture_validate_relaxed_consistency_visible_offset_advancement_Test::TestBodyWrapped()::$_5, raft_fixture_validate_relaxed_consistency_visible_offset_advancement_Test::TestBodyWrapped()::$_6>
2024-02-09 05:18:08 CST Test Exit code 132
2024-02-09 05:18:08 CST Decoded a Seastar backtrace:
2024-02-09 05:18:08 CST [Backtrace #0]
2024-02-09 05:18:08 CST void seastar::backtrace<seastar::current_backtrace_tasklocal()::$_0>(seastar::current_backtrace_tasklocal()::$_0&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/include/seastar/util/backtrace.hh:64
2024-02-09 05:18:08 CST  (inlined by) seastar::current_backtrace_tasklocal() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:98
2024-02-09 05:18:08 CST  (inlined by) seastar::current_tasktrace() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:149
2024-02-09 05:18:08 CST  (inlined by) seastar::current_backtrace() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:182
2024-02-09 05:18:08 CST operator() at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-00bc458ca0fa1a020-1/redpanda/vtools/src/v/raft/tests/basic_raft_fixture_test.cc:304
2024-02-09 05:18:08 CST seastar::internal::do_until_state<raft_fixture_validate_relaxed_consistency_visible_offset_advancement_Test::TestBodyWrapped()::$_5, raft_fixture_validate_relaxed_consistency_visible_offset_advancement_Test::TestBodyWrapped()::$_6>::run_and_dispose() at /vectorized/include/seastar/core/loop.hh:303
2024-02-09 05:18:08 CST seastar::reactor::run_tasks(seastar::reactor::task_queue&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:2750
2024-02-09 05:18:08 CST  (inlined by) seastar::reactor::run_some_tasks() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3213
2024-02-09 05:18:08 CST seastar::reactor::do_run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3397
2024-02-09 05:18:08 CST seastar::reactor::run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3265
2024-02-09 05:18:08 CST seastar::app_template::run_deprecated(int, char**, std::__1::function<void ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.cc:276
2024-02-09 05:18:08 CST seastar::app_template::run(int, char**, std::__1::function<seastar::future<int> ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.cc:167
2024-02-09 05:18:08 CST operator() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/testing/test_runner.cc:75
2024-02-09 05:18:08 CST  (inlined by) decltype ((std::declval<seastar::testing::test_runner::start_thread(int, char**)::$_0&>())()) std::__1::__invoke[abi:v160004]<seastar::testing::test_runner::start_thread(int, char**)::$_0&>(seastar::testing::test_runner::start_thread(int, char**)::$_0&) at /vectorized/llvm/bin/../include/c++/v1/__functional/invoke.h:394
2024-02-09 05:18:08 CST  (inlined by) void std::__1::__invoke_void_return_wrapper<void, true>::__call<seastar::testing::test_runner::start_thread(int, char**)::$_0&>(seastar::testing::test_runner::start_thread(int, char**)::$_0&) at /vectorized/llvm/bin/../include/c++/v1/__functional/invoke.h:487
2024-02-09 05:18:08 CST  (inlined by) std::__1::__function::__alloc_func<seastar::testing::test_runner::start_thread(int, char**)::$_0, std::__1::allocator<seastar::testing::test_runner::start_thread(int, char**)::$_0>, void ()>::operator()[abi:v160004]() at /vectorized/llvm/bin/../include/c++/v1/__functional/function.h:185
2024-02-09 05:18:08 CST  (inlined by) std::__1::__function::__func<seastar::testing::test_runner::start_thread(int, char**)::$_0, std::__1::allocator<seastar::testing::test_runner::start_thread(int, char**)::$_0>, void ()>::operator()() at /vectorized/llvm/bin/../include/c++/v1/__functional/function.h:356
2024-02-09 05:18:08 CST std::__1::__function::__value_func<void ()>::operator()[abi:v160004]() const at /vectorized/llvm/bin/../include/c++/v1/__functional/function.h:510
2024-02-09 05:18:08 CST  (inlined by) std::__1::function<void ()>::operator()() const at /vectorized/llvm/bin/../include/c++/v1/__functional/function.h:1156
2024-02-09 05:18:08 CST  (inlined by) seastar::posix_thread::start_routine(void*) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/posix.cc:90
2024-02-09 05:18:08 CST /lib64/libc.so.6: ELF 64-bit LSB shared object, x86-64, version 1 (GNU/Linux), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, BuildID[sha1]=6e7b96dfb83f0bdcb6a410469b82f86415e5ada3, for GNU/Linux 3.2.0, not stripped
2024-02-09 05:18:08 CST 

JIRA Link: CORE-1766

[rockwotj]

Found this here: https://buildkite.com/redpanda/redpanda/builds/45637#018e0a83-9a4f-4700-9772-8945dbe7c2a4

[bharathv]

https://github.com/redpanda-data/redpanda/pull/17498 fixed this I believe, lets reopen if it shows up again.