scylladb / scylladb

NoSQL data store using the seastar framework, compatible with Apache Cassandra
http://scylladb.com
GNU Affero General Public License v3.0
13.4k stars 1.27k forks source link

make_streaming_consumer passes reference to token_metadata to check_needs_view_update_path without holding ptr #20979

Open bhalevy opened 1 day ago

bhalevy commented 1 day ago

Seen in https://jenkins.scylladb.com/job/scylla-master/job/dtest-release/699/testReport/secondary_indexes_test/TestSecondaryIndexes/Run_Dtest_Parallel_Cloud_Machines___FullDtest___full_split002___test_decommission_node_during_index_build/

ccmlib.node.ToolError: Subprocess /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node2/bin/scylla nodetool -h 127.0.13.2 -p 10000 decommission exited with non-zero status; exit status: 4; 
stderr: error executing POST request to http://127.0.13.2:10000/storage_service/decommission with parameters {}: remote replied with status code 500 Internal Server Error:
std::runtime_error (Decommission failed. See earlier errors (Rolled back: Failed to drain tablets: std::runtime_error (raft topology: exec_global_command(barrier) failed with seastar::rpc::closed_error (connection is closed))). Request ID: 3a92a9b4-81d5-11ef-9289-b0ba9154192e)
...
failed on teardown with "AssertionError: Core file(s) found. Marking test as failed."

https://jenkins.scylladb.com/job/scylla-master/job/dtest-release/699/artifact/logs-full.release.002/1727993853398_secondary_indexes_test.py%3A%3ATestSecondaryIndexes%3A%3Atest_decommission_node_during_index_build/node3.log

Scylla version 6.3.0~dev-0.20241003.38088daa1f12 with build-id dead7c5c7bc6f2ce79f489bb3fd48acb38ea0801 starting ...

INFO  2024-10-03 22:17:06,788 [shard 0: gms] schema_tables - Altering ks.cf id=fd147180-81d4-11ef-b06c-67e88bea2d35 version=39b2c8d0-81d5-11ef-9df9-9026feed74c9
INFO  2024-10-03 22:17:06,789 [shard 0: gms] schema_tables - Creating ks.b_index_index id=39b2c8d1-81d5-11ef-9df9-9026feed74c9 version=39b2c8d2-81d5-11ef-9df9-9026feed74c9
INFO  2024-10-03 22:17:06,789 [shard 0: gms] schema_tables - Tablet metadata changed
INFO  2024-10-03 22:17:06,795 [shard 0: gms] query_processor - Column definitions for ks.cf changed, invalidating related prepared statements
INFO  2024-10-03 22:17:06,795 [shard 0: gms] view - Building view ks.b_index_index, starting at token minimum token
INFO  2024-10-03 22:17:06,795 [shard 1: gms] query_processor - Column definitions for ks.cf changed, invalidating related prepared statements
INFO  2024-10-03 22:17:06,796 [shard 0: gms] migration_manager - Gossiping my schema version 39b2ca92-81d5-11ef-96bf-35bd5b4f4772
INFO  2024-10-03 22:17:06,796 [shard 0: gms] schema_tables - Schema version changed to 39b2ca92-81d5-11ef-96bf-35bd5b4f4772
INFO  2024-10-03 22:17:08,287 [shard 0:strm] raft_topology - start cleanup
INFO  2024-10-03 22:17:08,287 [shard 0:strm] database - Forcing new commitlog segment and flushing all tables
INFO  2024-10-03 22:17:08,287 [shard 1:strm] database - Forcing new commitlog segment and flushing all tables
INFO  2024-10-03 22:17:08,307 [shard 1:comp] compaction - [Compact system.compaction_history 3a9ba230-81d5-11ef-8cd7-408b33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/me-3gk2_1pwk_1pq81253romeczuy9g-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/me-3gk2_1pwh_5vjqp253romeczuy9g-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,312 [shard 0:comp] compaction - [Compact system.compaction_history 3a9c6580-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/me-3gk2_1pwk_1pq812o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/me-3gk2_1pwi_01xg02o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,323 [shard 1:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/me-3gk2_1pwk_1tstt253romeczuy9g-big-Filter.db: resizing bitset from 328 bytes to 40 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,323 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/me-3gk2_1pwk_1v34g2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 40 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,351 [shard 0:comp] compaction - [Compact system.compaction_history 3a9c6580-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/me-3gk2_1pwk_1v34g2o1k81v3jwdmc-big-Data.db:level=0]. 161kB to 89kB (~55% of original) in 21ms = 7MB/s. ~256 total partitions merged to 28.
INFO  2024-10-03 22:17:08,351 [shard 0:comp] compaction - [Compact system.peers 3aa258f0-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/peers-37f71aca7dc2383ba70672528af04d4f/me-3gk2_1pwk_1vq9s2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/peers-37f71aca7dc2383ba70672528af04d4f/me-3gk2_1pwi_0mi6p2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,361 [shard 1:comp] compaction - [Compact system.compaction_history 3a9ba230-81d5-11ef-8cd7-408b33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/compaction_history-b4dbb7b4dc493fb5b3bfce6e434832ca/me-3gk2_1pwk_1tstt253romeczuy9g-big-Data.db:level=0]. 146kB to 97kB (~66% of original) in 47ms = 3MB/s. ~256 total partitions merged to 26.
INFO  2024-10-03 22:17:08,370 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/peers-37f71aca7dc2383ba70672528af04d4f/me-3gk2_1pwk_23g1s2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,379 [shard 0:comp] compaction - [Compact system.peers 3aa258f0-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/peers-37f71aca7dc2383ba70672528af04d4f/me-3gk2_1pwk_23g1s2o1k81v3jwdmc-big-Data.db:level=0]. 48kB to 24kB (~49% of original) in 24ms = 2MB/s. ~256 total partitions merged to 3.
INFO  2024-10-03 22:17:08,379 [shard 0:comp] compaction - [Compact system.topology 3aa69eb0-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/topology-5be1feb3929e3df98da8d771c36129a0/me-3gk2_1pwk_255s02o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/topology-5be1feb3929e3df98da8d771c36129a0/me-3gk2_1pwi_0vi9c2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,385 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/topology-5be1feb3929e3df98da8d771c36129a0/me-3gk2_1pwk_298dt2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,391 [shard 0:strm] compaction_manager - Stopping 1 tasks for 0 ongoing compactions for table system_distributed.cdc_streams_descriptions_v2 compaction_group=0 due to user-triggered operation
INFO  2024-10-03 22:17:08,391 [shard 0:strm] compaction_manager - The following SSTables require cleanup in this compaction: [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_distributed/cdc_streams_descriptions_v2-0bf73fd765b236b085e5658131d5df36/me-3gk2_1pwi_3261t2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,391 [shard 0:strm] compaction - [Cleanup system_distributed.cdc_streams_descriptions_v2 3aa87370-81d5-11ef-af6f-408a33b71bf4] Cleaning [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_distributed/cdc_streams_descriptions_v2-0bf73fd765b236b085e5658131d5df36/me-3gk2_1pwi_3261t2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,391 [shard 0:comp] compaction - [Compact system.topology 3aa69eb0-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/topology-5be1feb3929e3df98da8d771c36129a0/me-3gk2_1pwk_298dt2o1k81v3jwdmc-big-Data.db:level=0]. 41kB to 33kB (~81% of original) in 10ms = 4MB/s. ~256 total partitions merged to 1.
INFO  2024-10-03 22:17:08,392 [shard 0:comp] compaction - [Compact system.scylla_table_schema_history 3aa89a80-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/scylla_table_schema_history-0191a53e40f031d49171b0d19ffb17b4/me-3gk2_1ptp_0nd1s2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/scylla_table_schema_history-0191a53e40f031d49171b0d19ffb17b4/me-3gk2_1pwk_28sy82o1k81v3jwdmc-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,399 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/scylla_table_schema_history-0191a53e40f031d49171b0d19ffb17b4/me-3gk2_1pwk_2c0ox2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,399 [shard 0:strm] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_distributed/cdc_streams_descriptions_v2-0bf73fd765b236b085e5658131d5df36/me-3gk2_1pwk_2bsz52o1k81v3jwdmc-big-Filter.db: resizing bitset from 168 bytes to 8 bytes. sstable origin: cleanup
INFO  2024-10-03 22:17:08,405 [shard 0:comp] compaction - [Compact system.scylla_table_schema_history 3aa89a80-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/scylla_table_schema_history-0191a53e40f031d49171b0d19ffb17b4/me-3gk2_1pwk_2c0ox2o1k81v3jwdmc-big-Data.db:level=0]. 11kB to 5793 bytes (~50% of original) in 10ms = 1MB/s. ~256 total partitions merged to 1.
INFO  2024-10-03 22:17:08,406 [shard 0:comp] compaction - [Compact system.raft 3aaabd60-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/raft-3e17774c57f539939625327cbafbf5bb/me-3gk2_1pwk_243742o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/raft-3e17774c57f539939625327cbafbf5bb/me-3gk2_1pwi_2zlgh2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,407 [shard 0:strm] compaction - [Cleanup system_distributed.cdc_streams_descriptions_v2 3aa87370-81d5-11ef-af6f-408a33b71bf4] Cleaned 1 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_distributed/cdc_streams_descriptions_v2-0bf73fd765b236b085e5658131d5df36/me-3gk2_1pwk_2bsz52o1k81v3jwdmc-big-Data.db:level=0]. 150kB to 139kB (~92% of original) in 12ms = 12MB/s. ~128 total partitions merged to 3.
INFO  2024-10-03 22:17:08,409 [shard 0:strm] raft_topology - cleanup ended
INFO  2024-10-03 22:17:08,418 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/raft-3e17774c57f539939625327cbafbf5bb/me-3gk2_1pwk_2f8fk2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,429 [shard 0:comp] compaction - [Compact system.raft 3aaabd60-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/raft-3e17774c57f539939625327cbafbf5bb/me-3gk2_1pwk_2f8fk2o1k81v3jwdmc-big-Data.db:level=0]. 301kB to 296kB (~98% of original) in 18ms = 16MB/s. ~256 total partitions merged to 1.
INFO  2024-10-03 22:17:08,429 [shard 0:comp] compaction - [Compact system_schema.keyspaces 3aae3fd0-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/me-3gk2_1pwk_1pxxs2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/me-3gk2_1pwh_5wels2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,434 [shard 0:strm] raft_topology - cleanup flag clearing: concurrent operation is detected, retrying.
INFO  2024-10-03 22:17:08,435 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/me-3gk2_1pwk_2jy6p2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 16 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,438 [shard 0:comp] compaction - [Compact system_schema.keyspaces 3aae3fd0-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/keyspaces-abac5682dea631c5b535b3d6cffd0fb6/me-3gk2_1pwk_2jy6p2o1k81v3jwdmc-big-Data.db:level=0]. 11kB to 5981 bytes (~51% of original) in 8ms = 1MB/s. ~256 total partitions merged to 7.
INFO  2024-10-03 22:17:08,438 [shard 0:comp] compaction - [Compact system_schema.dropped_columns 3aaf9f60-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/me-3gk2_1pwk_1x8a82o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/me-3gk2_1pwi_0ai342o1k81v3jwdmc-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,441 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/me-3gk2_1pwk_2m3cg2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 16 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,446 [shard 0:comp] compaction - [Compact system_schema.dropped_columns 3aaf9f60-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/dropped_columns-5e7583b5f3f43af19a39b7e1d6f5f11f/me-3gk2_1pwk_2m3cg2o1k81v3jwdmc-big-Data.db:level=0]. 11kB to 6184 bytes (~53% of original) in 6ms = 1MB/s. ~256 total partitions merged to 6.
INFO  2024-10-03 22:17:08,446 [shard 0:comp] compaction - [Compact system_schema.computed_columns 3ab0d7e0-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/computed_columns-cc7c7069374033c192a4c3de78dbd2c4/me-3gk2_1pwk_1yikw2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/computed_columns-cc7c7069374033c192a4c3de78dbd2c4/me-3gk2_1pwi_0g2pc2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,449 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/computed_columns-cc7c7069374033c192a4c3de78dbd2c4/me-3gk2_1pwk_2nlcx2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 16 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,460 [shard 0:comp] compaction - [Compact system_schema.computed_columns 3ab0d7e0-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/computed_columns-cc7c7069374033c192a4c3de78dbd2c4/me-3gk2_1pwk_2nlcx2o1k81v3jwdmc-big-Data.db:level=0]. 11kB to 6009 bytes (~52% of original) in 11ms = 1MB/s. ~256 total partitions merged to 6.
INFO  2024-10-03 22:17:08,460 [shard 0:comp] compaction - [Compact system.local 3ab2fac0-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/local-7ad54392bcdd35a684174e047860b377/me-3gk2_1pwk_1xvfk2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/local-7ad54392bcdd35a684174e047860b377/me-3gk2_1pur_3j3m82o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,463 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/local-7ad54392bcdd35a684174e047860b377/me-3gk2_1pwk_2qldt2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,467 [shard 0:comp] compaction - [Compact system.local 3ab2fac0-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/local-7ad54392bcdd35a684174e047860b377/me-3gk2_1pwk_2qldt2o1k81v3jwdmc-big-Data.db:level=0]. 23kB to 12kB (~52% of original) in 6ms = 3MB/s. ~256 total partitions merged to 1.
INFO  2024-10-03 22:17:08,467 [shard 0:comp] compaction - [Compact system.tablets 3ab40c30-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/tablets-fd4f7a4696bd3e7391bf99eb77e82a5c/me-3gk2_1pur_3klmp2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/tablets-fd4f7a4696bd3e7391bf99eb77e82a5c/me-3gk2_1pwk_298du2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,476 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/tablets-fd4f7a4696bd3e7391bf99eb77e82a5c/me-3gk2_1pwk_2s3e92o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,484 [shard 0:comp] compaction - [Compact system.tablets 3ab40c30-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/tablets-fd4f7a4696bd3e7391bf99eb77e82a5c/me-3gk2_1pwk_2s3e92o1k81v3jwdmc-big-Data.db:level=0]. 12kB to 6663 bytes (~51% of original) in 16ms = 805kB/s. ~256 total partitions merged to 2.
INFO  2024-10-03 22:17:08,485 [shard 0:comp] compaction - [Compact system.scylla_local 3ab6cb50-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/scylla_local-2972ec7ffb2038ddaac1d876f2e3fcbd/me-3gk2_1pwk_22swg2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/scylla_local-2972ec7ffb2038ddaac1d876f2e3fcbd/me-3gk2_1pwi_313gx2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,488 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/scylla_local-2972ec7ffb2038ddaac1d876f2e3fcbd/me-3gk2_1pwk_2vya92o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 16 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,501 [shard 0:comp] compaction - [Compact system.scylla_local 3ab6cb50-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/scylla_local-2972ec7ffb2038ddaac1d876f2e3fcbd/me-3gk2_1pwk_2vya92o1k81v3jwdmc-big-Data.db:level=0]. 13kB to 6722 bytes (~51% of original) in 11ms = 1MB/s. ~256 total partitions merged to 7.
INFO  2024-10-03 22:17:08,501 [shard 0:comp] compaction - [Compact system_schema.indexes 3ab93c50-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/me-3gk2_1ptp_0saip2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/me-3gk2_1pwk_27axs2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,505 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/me-3gk2_1pwk_2zlgg2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,514 [shard 0:comp] compaction - [Compact system_schema.indexes 3ab93c50-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/indexes-0feb57ac311f382fba6d9024d305702f/me-3gk2_1pwk_2zlgg2o1k81v3jwdmc-big-Data.db:level=0]. 11kB to 5666 bytes (~50% of original) in 5ms = 2240kB/s. ~256 total partitions merged to 3.
INFO  2024-10-03 22:17:08,514 [shard 0:comp] compaction - [Compact system.group0_history 3abb3820-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/group0_history-027e42f5683a3ed7b404a0100762063c/me-3gk2_1pwk_27ink2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/group0_history-027e42f5683a3ed7b404a0100762063c/me-3gk2_1pur_3g3ld2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,523 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/group0_history-027e42f5683a3ed7b404a0100762063c/me-3gk2_1pwk_32drk2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,528 [shard 0:comp] compaction - [Compact system.group0_history 3abb3820-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/group0_history-027e42f5683a3ed7b404a0100762063c/me-3gk2_1pwk_32drk2o1k81v3jwdmc-big-Data.db:level=0]. 13kB to 8085 bytes (~60% of original) in 12ms = 1MB/s. ~256 total partitions merged to 1.
INFO  2024-10-03 22:17:08,528 [shard 0:comp] compaction - [Compact system.topology_requests 3abd5b00-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/topology_requests-b3068525d0f239c28250584f9b1bf460/me-3gk2_1pwk_1z5q82o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/topology_requests-b3068525d0f239c28250584f9b1bf460/me-3gk2_1ptp_0pxn52o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,531 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/topology_requests-b3068525d0f239c28250584f9b1bf460/me-3gk2_1pwk_3562p2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 16 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,535 [shard 0:comp] compaction - [Compact system.topology_requests 3abd5b00-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/topology_requests-b3068525d0f239c28250584f9b1bf460/me-3gk2_1pwk_3562p2o1k81v3jwdmc-big-Data.db:level=0]. 11kB to 6032 bytes (~52% of original) in 6ms = 1MB/s. ~256 total partitions merged to 5.
INFO  2024-10-03 22:17:08,535 [shard 0:comp] compaction - [Compact system_schema.scylla_tables 3abe6c70-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/scylla_tables-5d912ff1f7593665b2c88042ab5103dd/me-3gk2_1pwk_1s33k2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/scylla_tables-5d912ff1f7593665b2c88042ab5103dd/me-3gk2_1pwi_01aao2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,538 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/scylla_tables-5d912ff1f7593665b2c88042ab5103dd/me-3gk2_1pwk_36vsw2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 16 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,545 [shard 0:comp] compaction - [Compact system_schema.scylla_tables 3abe6c70-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/scylla_tables-5d912ff1f7593665b2c88042ab5103dd/me-3gk2_1pwk_36vsw2o1k81v3jwdmc-big-Data.db:level=0]. 14kB to 8372 bytes (~59% of original) in 6ms = 2MB/s. ~256 total partitions merged to 6.
INFO  2024-10-03 22:17:08,546 [shard 0:comp] compaction - [Compact system_schema.columns 3ac01a20-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/me-3gk2_1pwk_1tde82o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/me-3gk2_1pwi_0dae82o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,557 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/me-3gk2_1pwk_398og2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 16 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,562 [shard 0:comp] compaction - [Compact system_schema.columns 3ac01a20-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/columns-24101c25a2ae3af787c1b40ee1aca33f/me-3gk2_1pwk_398og2o1k81v3jwdmc-big-Data.db:level=0]. 27kB to 22kB (~79% of original) in 14ms = 1MB/s. ~256 total partitions merged to 6.
INFO  2024-10-03 22:17:08,562 [shard 0:comp] compaction - [Compact system.cdc_local 3ac28b20-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/cdc_local-0bcaffd40c833eadad13dc1d5015b77c/me-3gk2_1pwk_268cw2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/cdc_local-0bcaffd40c833eadad13dc1d5015b77c/me-3gk2_1pur_3hdw12o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,569 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/cdc_local-0bcaffd40c833eadad13dc1d5015b77c/me-3gk2_1pwk_3cgf52o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,580 [shard 0:comp] compaction - [Compact system.cdc_local 3ac28b20-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system/cdc_local-0bcaffd40c833eadad13dc1d5015b77c/me-3gk2_1pwk_3cgf52o1k81v3jwdmc-big-Data.db:level=0]. 10kB to 5385 bytes (~49% of original) in 16ms = 673kB/s. ~256 total partitions merged to 1.
INFO  2024-10-03 22:17:08,580 [shard 0:comp] compaction - [Compact system_schema.views 3ac54a40-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/views-9786ac1cdd583201a7cdad556410c985/me-3gk2_1pwi_06n742o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/views-9786ac1cdd583201a7cdad556410c985/me-3gk2_1pwk_1ufz42o1k81v3jwdmc-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,588 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/views-9786ac1cdd583201a7cdad556410c985/me-3gk2_1pwk_3gbb52o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 8 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,598 [shard 0:comp] compaction - [Compact system_schema.views 3ac54a40-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/views-9786ac1cdd583201a7cdad556410c985/me-3gk2_1pwk_3gbb52o1k81v3jwdmc-big-Data.db:level=0]. 14kB to 7343 bytes (~51% of original) in 16ms = 891kB/s. ~256 total partitions merged to 3.
INFO  2024-10-03 22:17:08,598 [shard 0:comp] compaction - [Compact system_schema.view_virtual_columns 3ac80960-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/view_virtual_columns-08843b6345dc3be29798a0418295cfaa/me-3gk2_1pwk_1wl4x2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/view_virtual_columns-08843b6345dc3be29798a0418295cfaa/me-3gk2_1pwi_097sg2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable]
INFO  2024-10-03 22:17:08,609 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/view_virtual_columns-08843b6345dc3be29798a0418295cfaa/me-3gk2_1pwk_3k6752o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 16 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,623 [shard 0:comp] compaction - [Compact system_schema.view_virtual_columns 3ac80960-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/view_virtual_columns-08843b6345dc3be29798a0418295cfaa/me-3gk2_1pwk_3k6752o1k81v3jwdmc-big-Data.db:level=0]. 11kB to 6186 bytes (~52% of original) in 22ms = 533kB/s. ~256 total partitions merged to 6.
INFO  2024-10-03 22:17:08,623 [shard 0:comp] compaction - [Compact system_schema.tables 3acbd9f0-81d5-11ef-af6f-408a33b71bf4] Compacting [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/me-3gk2_1pwk_1r0io2o1k81v3jwdmc-big-Data.db:level=0:origin=memtable,/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/me-3gk2_1pwi_2yivk2o1k81v3jwdmc-big-Data.db:level=0:origin=compaction]
INFO  2024-10-03 22:17:08,640 [shard 0:comp] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/me-3gk2_1pwk_3pj3l2o1k81v3jwdmc-big-Filter.db: resizing bitset from 328 bytes to 16 bytes. sstable origin: compaction
INFO  2024-10-03 22:17:08,650 [shard 0:comp] compaction - [Compact system_schema.tables 3acbd9f0-81d5-11ef-af6f-408a33b71bf4] Compacted 2 sstables to [/jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/system_schema/tables-afddfb9dbc1e30688056eed6c302ba09/me-3gk2_1pwk_3pj3l2o1k81v3jwdmc-big-Data.db:level=0]. 21kB to 14kB (~67% of original) in 24ms = 909kB/s. ~256 total partitions merged to 6.
INFO  2024-10-03 22:17:08,732 [shard 0:strm] range_streamer - Tablet migration starts, nr_ranges_remaining=1
INFO  2024-10-03 22:17:08,732 [shard 0:strm] range_streamer - Tablet migration with [127.0.13.2] for keyspace=ks started, nodes_to_stream=1
INFO  2024-10-03 22:17:08,732 [shard 0:strm] range_streamer - Tablet migration with 127.0.13.2 for keyspace=ks, streaming [0, 1) out of 1 ranges
INFO  2024-10-03 22:17:08,732 [shard 0:strm] stream_session - [Stream #3adc7bc0-81d5-11ef-af6f-408a33b71bf4] Executing streaming plan for Tablet migration-ks-index-0 with peers={127.0.13.2}, master
INFO  2024-10-03 22:17:08,810 [shard 0:strm] sstable - Rebuilding bloom filter /jenkins/workspace/scylla-master/dtest-release/scylla/.dtest/dtest-2yksbjmn/test/node3/data/ks/b_index_index-39b2c8d181d511ef9df99026feed74c9/me-3gk2_1pwk_4he6o2o1k81v3jwdmc-big-Filter.db: resizing bitset from 5768 bytes to 6336 bytes. sstable origin: streaming
INFO  2024-10-03 22:17:08,818 [shard 0:strm] stream_session - [Stream #3adc7bc0-81d5-11ef-af6f-408a33b71bf4] Write to sstable for ks=ks, cf=b_index_index, estimated_partitions=4608, received_partitions=5064
INFO  2024-10-03 22:17:08,820 [shard 0:strm] range_streamer - Tablet migration starts, nr_ranges_remaining=1
INFO  2024-10-03 22:17:08,820 [shard 0:strm] range_streamer - Tablet migration with [127.0.13.2] for keyspace=ks started, nodes_to_stream=1
INFO  2024-10-03 22:17:08,820 [shard 0:strm] range_streamer - Tablet migration with 127.0.13.2 for keyspace=ks, streaming [0, 1) out of 1 ranges
INFO  2024-10-03 22:17:08,820 [shard 0:strm] stream_session - [Stream #3ae9e940-81d5-11ef-af6f-408a33b71bf4] Executing streaming plan for Tablet migration-ks-index-0 with peers={127.0.13.2}, master
INFO  2024-10-03 22:17:08,824 [shard 0:strm] stream_session - [Stream #3adc7bc0-81d5-11ef-af6f-408a33b71bf4] Streaming plan for Tablet migration-ks-index-0 succeeded, peers={127.0.13.2}, tx=0 KiB, 0.00 KiB/s, rx=909 KiB, 9832.08 KiB/s
INFO  2024-10-03 22:17:08,824 [shard 0:strm] range_streamer - Finished 1 out of 1 ranges for tablet migration, finished percentage=1
INFO  2024-10-03 22:17:08,824 [shard 0:strm] range_streamer - Tablet migration with 127.0.13.2 for keyspace=ks succeeded, took 0.092592046 seconds
INFO  2024-10-03 22:17:08,824 [shard 0:strm] range_streamer - Tablet migration succeeded, took 0 seconds, nr_ranges_remaining=0
Segmentation fault on shard 1, in scheduling group streaming.
Backtrace:
  0x5cda8f4
  0x5c96a7b
  0x5cce2fc
  /jenkins/workspace/scylla-master/dtest-release/scylla/.ccm/scylla-repository/38088daa1f125084cd88d5f6d4218cf57bf5cb07/libreloc/libc.so.6+0x40cff
  0x3dc78a3
  0x3d63326
  0x39fc57c
  0x5ca771f
  0x5ca8c9a
  0x5ca9e77
  0x5cce9b0
  0x5c698fa
  /jenkins/workspace/scylla-master/dtest-release/scylla/.ccm/scylla-repository/38088daa1f125084cd88d5f6d4218cf57bf5cb07/libreloc/libc.so.6+0x976d6
  /jenkins/workspace/scylla-master/dtest-release/scylla/.ccm/scylla-repository/38088daa1f125084cd88d5f6d4218cf57bf5cb07/libreloc/libc.so.6+0x11b60b

Decoded:

[Backtrace #0]
void seastar::backtrace<seastar::backtrace_buffer::append_backtrace()::{lambda(seastar::frame)#1}>(seastar::backtrace_buffer::append_backtrace()::{lambda(seastar::frame)#1}&&) at ./build/release/seastar/./seastar/include/seastar/util/backtrace.hh:68
seastar::print_with_backtrace(seastar::backtrace_buffer&, bool) at ./build/release/seastar/./build/release/seastar/./seastar/src/core/reactor.cc:825
seastar::print_with_backtrace(char const*, bool) at ./build/release/seastar/./build/release/seastar/./seastar/src/core/reactor.cc:870
 (inlined by) seastar::sigsegv_action() at ./build/release/seastar/./build/release/seastar/./seastar/src/core/reactor.cc:3998
 (inlined by) seastar::install_oneshot_signal_handler<11, (void (*)())(&seastar::sigsegv_action)>()::{lambda(int, siginfo_t*, void*)#1}::operator()(int, siginfo_t*, void*) const at ./build/release/seastar/./build/release/seastar/./seastar/src/core/reactor.cc:3980
 (inlined by) seastar::install_oneshot_signal_handler<11, (void (*)())(&seastar::sigsegv_action)>()::{lambda(int, siginfo_t*, void*)#1}::__invoke(int, siginfo_t*, void*) at ./build/release/seastar/./build/release/seastar/./seastar/src/core/reactor.cc:3975
/data/scylla-s3-reloc.cache/by-build-id/dead7c5c7bc6f2ce79f489bb3fd48acb38ea0801/extracted/scylla/libreloc/libc.so.6: ELF 64-bit LSB shared object, x86-64, version 1 (GNU/Linux), dynamically linked, interpreter /lib64/ld-linux-x86-64.so.2, BuildID[sha1]=77c77fee058b19c6f001cf2cb0371ce3b8341211, for GNU/Linux 3.2.0, not stripped

__GI___sigaction at :?
locator::topology::find_node(utils::tagged_uuid<locator::host_id_tag>) const at ././locator/topology.cc:431
locator::token_metadata::get_endpoint_for_host_id_if_known(utils::tagged_uuid<locator::host_id_tag>) const at ././locator/token_metadata.cc:553
db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0::operator()(std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) const::{lambda(std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > const&)#1}::operator()(std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > const&) const at ././db/view/view.cc:3148
 (inlined by) bool boost::algorithm::any_of<std::__detail::_Node_const_iterator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> >, false, false>, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0::operator()(std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) const::{lambda(std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > const&)#1}>(std::__detail::_Node_const_iterator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> >, false, false>, std::__detail::_Node_const_iterator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> >, false, false>, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0::operator()(std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) const::{lambda(std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > const&)#1}) at /usr/include/boost/algorithm/cxx11/any_of.hpp:35
 (inlined by) bool boost::algorithm::any_of<std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0::operator()(std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) const::{lambda(std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > const&)#1}>(std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > const&, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0::operator()(std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) const::{lambda(std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > const&)#1}) at /usr/include/boost/algorithm/cxx11/any_of.hpp:50
 (inlined by) db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0::operator()(std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) const at ././db/view/view.cc:3146
 (inlined by) bool std::__invoke_impl<bool, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >(std::__invoke_other, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) at /usr/lib/gcc/x86_64-redhat-linux/14/../../../../include/c++/14/bits/invoke.h:61
 (inlined by) std::__invoke_result<db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >::type std::__invoke<db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >(db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) at /usr/lib/gcc/x86_64-redhat-linux/14/../../../../include/c++/14/bits/invoke.h:96
 (inlined by) std::invoke_result<db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >::type std::invoke<db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >(db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) at /usr/lib/gcc/x86_64-redhat-linux/14/../../../../include/c++/14/functional:120
 (inlined by) auto seastar::internal::future_invoke<db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >(db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > >&&) at ././seastar/include/seastar/core/future.hh:1172
 (inlined by) seastar::future<std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >::then_impl_nrvo<db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0, seastar::future<bool> >(db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&&)::{lambda(seastar::internal::promise_base_with_type<bool>&&, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, seastar::future_state<std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >&&)#1}::operator()(seastar::internal::promise_base_with_type<bool>&&, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, seastar::future_state<std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >&&) const::{lambda()#1}::operator()() const at ././seastar/include/seastar/core/future.hh:1486
 (inlined by) _ZN7seastar8futurizeIbE22satisfy_with_result_ofITkSt9invocableZZNS_6futureISt13unordered_mapIN5utils11tagged_uuidIN7locator11host_id_tagEEENS_13basic_sstringIcjLj15ELb1EEESt4hashIS9_ESt8equal_toIS9_ESaISt4pairIKS9_SB_EEEE14then_impl_nrvoIZN2db4view12view_builder24check_view_build_ongoingERKNS7_14token_metadataERKSB_SU_E3$_0NS3_IbEEEET0_OT_ENKUlONS_8internal22promise_base_with_typeIbEERSV_ONS_12future_stateISK_EEE_clES13_S14_S17_EUlvE_EEvS13_SZ_ at ././seastar/include/seastar/core/future.hh:2019
 (inlined by) seastar::future<std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >::then_impl_nrvo<db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0, seastar::future<bool> >(db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&&)::{lambda(seastar::internal::promise_base_with_type<bool>&&, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, seastar::future_state<std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >&&)#1}::operator()(seastar::internal::promise_base_with_type<bool>&&, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, seastar::future_state<std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >&&) const at ././seastar/include/seastar/core/future.hh:1482
 (inlined by) seastar::continuation<seastar::internal::promise_base_with_type<bool>, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0, seastar::future<std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >::then_impl_nrvo<db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0, seastar::future<bool> >(db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&&)::{lambda(seastar::internal::promise_base_with_type<bool>&&, db::view::view_builder::check_view_build_ongoing(locator::token_metadata const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&, seastar::basic_sstring<char, unsigned int, 15u, true> const&)::$_0&, seastar::future_state<std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >&&)#1}, std::unordered_map<utils::tagged_uuid<locator::host_id_tag>, seastar::basic_sstring<char, unsigned int, 15u, true>, std::hash<utils::tagged_uuid<locator::host_id_tag> >, std::equal_to<utils::tagged_uuid<locator::host_id_tag> >, std::allocator<std::pair<utils::tagged_uuid<locator::host_id_tag> const, seastar::basic_sstring<char, unsigned int, 15u, true> > > > >::run_and_dispose() at ././seastar/include/seastar/core/future.hh:748
seastar::reactor::run_tasks(seastar::reactor::task_queue&) at ./build/release/seastar/./build/release/seastar/./seastar/src/core/reactor.cc:2621
seastar::reactor::run_some_tasks() at ./build/release/seastar/./build/release/seastar/./seastar/src/core/reactor.cc:3087
seastar::reactor::do_run() at ./build/release/seastar/./build/release/seastar/./seastar/src/core/reactor.cc:3255
std::_Function_handler<void (), seastar::smp::configure(seastar::smp_options const&, seastar::reactor_options const&)::$_0>::_M_invoke(std::_Any_data const&) at ./build/release/seastar/./build/release/seastar/./seastar/src/core/reactor.cc:4574
seastar::posix_thread::start_routine(void*) at /usr/lib/gcc/x86_64-redhat-linux/14/../../../../include/c++/14/bits/std_function.h:591

Looking at the code, it looks like we pass a reference to the token_metadata without holding a token_metadata_ptr or the effective_replication_map, in https://github.com/scylladb/scylladb/blob/960aa38cf32bb7e167df6a6767d879d0a51564fa/streaming/consumer.cc#L38

bhalevy commented 1 day ago

Core dump: https://jenkins.scylladb.com/job/scylla-master/job/dtest-release/699/artifact/logs-full.release.002/1727993853398_secondary_indexes_test.py%3A%3ATestSecondaryIndexes%3A%3Atest_decommission_node_during_index_build/node3-reactor-1.3580.1727993828.core.gz