Signoz example is not working

Describe the bug

When you try to run Signoz example, located on https://github.com/kubeshop/tracetest/tree/main/examples/tracetest-signoz , and try to execute:

docker compose up

The entire command breaks after a while saying that clickhouse is not healthy, with a bunch of messages like this:

clickhouse                       | 2024.06.12 21:53:57.718726 [ 121 ] {} <Error> system.metric_log (ca0a8ece-6f32-42c6-8ca0-fc422f0d101f): Detaching broken part /var/lib/clickhouse/store/ca0/ca0a8ece-6f32-42c6-8ca0-fc422f0d101f/202406_1_1_0 (size: 138.24 KiB). If it happened after update, it is likely because of backward incompability. You need to resolve this manually
clickhouse                       | 2024.06.12 21:53:57.738898 [ 123 ] {} <Error> system.metric_log (ca0a8ece-6f32-42c6-8ca0-fc422f0d101f): Detaching broken part /var/lib/clickhouse/store/ca0/ca0a8ece-6f32-42c6-8ca0-fc422f0d101f/202406_1_6_1 (size: 142.47 KiB). If it happened after update, it is likely because of backward incompability. You need to resolve this manually
clickhouse                       | 2024.06.12 21:53:57.748356 [ 117 ] {} <Error> auto DB::MergeTreeData::loadDataPartsFromDisk(DB::MergeTreeData::DataPartsVector &, DB::MergeTreeData::DataPartsVector &, ThreadPool &, size_t, std::queue<std::vector<std::pair<String, DiskPtr>>> &, bool, const DB::MergeTreeSettingsPtr &)::(anonymous class)::operator()(const DB::String &, const DB::DiskPtr &) const: Code: 226. DB::Exception: Marks file '/var/lib/clickhouse/store/ca0/ca0a8ece-6f32-42c6-8ca0-fc422f0d101f/202406_7_7_0/data.mrk3' doesn't exist. (NO_FILE_IN_DATA_PART), Stack trace (when copying this message, always include the lines below):
clickhouse                       | 
clickhouse                       | 0. DB::Exception::Exception(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, int, bool) @ 0xa3ef75a in /usr/bin/clickhouse
clickhouse                       | 1. DB::Exception::Exception<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >(int, fmt::v8::basic_format_string<char, fmt::v8::type_identity<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > >::type>, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >&&) @ 0xa434458 in /usr/bin/clickhouse
clickhouse                       | 2. DB::MergeTreeDataPartCompact::loadIndexGranularity() @ 0x158c9789 in /usr/bin/clickhouse
clickhouse                       | 3. DB::IMergeTreeDataPart::loadColumnsChecksumsIndexes(bool, bool) @ 0x157cc03f in /usr/bin/clickhouse

Updating clickhouse to use their latest setup did not work.

kubeshop / tracetest

Signoz example is not working #3910