search

redpanda-data / redpanda

Redpanda is a streaming data platform for developers. Kafka API compatible. 10x faster. No ZooKeeper. No JVM!
https://redpanda.com
9.42k stars 577 forks source link

Oversized allocation: 557056 bytes in `cluster::leader_balancer::build_group_id_to_topic_rev` #10745

Closed ballard26 closed 1 month ago

ballard26 commented 1 year ago

Artifact URL: https://ci-artifacts.dev.vectorized.cloud:443/vtools/7520/01880eff-2a13-4369-b9c9-30fc45d70c74/vbuild/output/ducktape-release-clang-amd64.tgz

Test details:

tmp/ducktape/results/2023-05-12--001/LargeControllerSnapshotTest/test_join_restart/220/RedpandaService-0-139958544347200/ip-172-31-13-104/redpanda.log:579

Backtrace:

[shard 0] seastar_memory - oversized allocation: 557056 bytes. This is non-fatal, but could lead to latency and/or fragmentation issues. Please report: at                   
[Backtrace #3]                                                                                                                                                                                
{tmp/libexec/redpanda} 0x68d9814: void seastar::backtrace<seastar::current_backtrace_tasklocal()::$_3>(seastar::current_backtrace_tasklocal()::$_3&&) at /v/build/v_deps_build/seastar-prefix/
src/seastar/include/seastar/util/backtrace.hh:60                                                                                                                                              
 (inlined by) seastar::current_backtrace_tasklocal() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:86                                                             
 (inlined by) seastar::current_tasktrace() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:137                                                                      
 (inlined by) seastar::current_backtrace() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/util/backtrace.cc:170                                                                      
{tmp/libexec/redpanda} 0x65a0581: seastar::memory::cpu_pages::warn_large_allocation(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:780                 
 (inlined by) seastar::memory::cpu_pages::check_large_allocation(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:788                                    
 (inlined by) seastar::memory::cpu_pages::allocate_large(unsigned int) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:794                                             
 (inlined by) seastar::memory::allocate_large(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:1345                                                      
 (inlined by) seastar::memory::allocate(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:1406                                                            
{tmp/libexec/redpanda} 0x65b0441: operator new(unsigned long) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/memory.cc:2087
{tmp/libexec/redpanda} 0x4e519c6: void* std::__1::__libcpp_operator_new<unsigned long>(unsigned long) at /vectorized/llvm/bin/../include/c++/v1/new:245
 (inlined by) std::__1::__libcpp_allocate(unsigned long, unsigned long) at /vectorized/llvm/bin/../include/c++/v1/new:271
 (inlined by) std::__1::allocator<absl::lts_20220623::container_internal::AlignedType<8ul>>::allocate(unsigned long) at /vectorized/llvm/bin/../include/c++/v1/__memory/allocator.h:105
 (inlined by) std::__1::allocator_traits<std::__1::allocator<absl::lts_20220623::container_internal::AlignedType<8ul>>>::allocate(std::__1::allocator<absl::lts_20220623::container_internal::
AlignedType<8ul>>&, unsigned long) at /vectorized/llvm/bin/../include/c++/v1/__memory/allocator_traits.h:262
 (inlined by) void* absl::lts_20220623::container_internal::Allocate<8ul, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_consta
nt<bool, true>> const, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>>>(std::__1::allocator<std::__1::pair<detail::base_named_type<lon
g, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>>*, unsigne
d long) at /vectorized/include/absl/container/internal/container_memory.h:64
 (inlined by) absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1:
:integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>, absl::lts_20220623::hash_internal::Hash<detail::base_
named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<b
ool, true>>>, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const, detail::base_named_type<long, model::
revision_id_model_type, std::__1::integral_constant<bool, true>>>>>::initialize_slots() at /vectorized/include/absl/container/internal/raw_hash_set.h:1937
 (inlined by) absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1:
:integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>, absl::lts_20220623::hash_internal::Hash<detail::base_
named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<b
ool, true>>>, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const, detail::base_named_type<long, model::
revision_id_model_type, std::__1::integral_constant<bool, true>>>>>::resize(unsigned long) at /vectorized/include/absl/container/internal/raw_hash_set.h:1978
 (inlined by) absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1:
:integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>, absl::lts_20220623::hash_internal::Hash<detail::base_
named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<b
ool, true>>>, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const, detail::base_named_type<long, model::
revision_id_model_type, std::__1::integral_constant<bool, true>>>>>::rehash_and_grow_if_necessary() at /vectorized/include/absl/container/internal/raw_hash_set.h:2126
{tmp/libexec/redpanda} 0x4e5192a: absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_grou
p_id_type, std::__1::integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>, absl::lts_20220623::hash_internal
::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1:
:integral_constant<bool, true>>>, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const, detail::base_name
d_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>>>::prepare_insert(unsigned long) at /vectorized/include/absl/container/internal/raw_hash_set.h:2191
{tmp/libexec/redpanda} 0x4e3dc3f: std::__1::pair<unsigned long, bool> absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::b
ase_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>
>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::equal_to<detail::base_named_type<long,
 raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<b
ool, true>> const, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>>>::find_or_prepare_insert<detail::base_named_type<long, raft::raft_g
roup_id_type, std::__1::integral_constant<bool, true>>>(detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const&) at /vectorized/include/absl/c
ontainer/internal/raw_hash_set.h:2180
 (inlined by) std::__1::pair<absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_
type, std::__1::integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>, absl::lts_20220623::hash_internal::Has
h<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::inte
gral_constant<bool, true>>>, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const, detail::base_named_typ
e<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>>>::iterator, bool> absl::lts_20220623::container_internal::raw_hash_map<absl::lts_20220623::container_interna
l::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::
integral_constant<bool, true>>>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::equal_to
<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type,
 std::__1::integral_constant<bool, true>> const, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>>>::try_emplace_impl<detail::base_named
_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const&, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>(
detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const&, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_const
ant<bool, true>>&&) at /vectorized/include/absl/container/internal/raw_hash_map.h:185
 (inlined by) std::__1::pair<absl::lts_20220623::container_internal::raw_hash_set<absl::lts_20220623::container_internal::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_
type, std::__1::integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>, absl::lts_20220623::hash_internal::Has
h<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::equal_to<detail::base_named_type<long, raft::raft_group_id_type, std::__1::inte
gral_constant<bool, true>>>, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const, detail::base_named_typ
e<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>>>::iterator, bool> absl::lts_20220623::container_internal::raw_hash_map<absl::lts_20220623::container_interna
l::FlatHashMapPolicy<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::
integral_constant<bool, true>>>, absl::lts_20220623::hash_internal::Hash<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::equal_to
<detail::base_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>>, std::__1::allocator<std::__1::pair<detail::base_named_type<long, raft::raft_group_id_type,
 std::__1::integral_constant<bool, true>> const, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>>>>::try_emplace<detail::base_named_type
<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>>, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool, true>>, 0>(detail::b
ase_named_type<long, raft::raft_group_id_type, std::__1::integral_constant<bool, true>> const&, detail::base_named_type<long, model::revision_id_model_type, std::__1::integral_constant<bool,
 true>>&&) at /vectorized/include/absl/container/internal/raw_hash_map.h:129
 (inlined by) cluster::leader_balancer::build_group_id_to_topic_rev() const at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-06879a8c75b58e683-1/redpanda/redpanda/src/v/cluster/
scheduling/leader_balancer.cc:610
 (inlined by) cluster::leader_balancer::balance() (.resume) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-06879a8c75b58e683-1/redpanda/redpanda/src/v/cluster/scheduling/leade
r_balancer.cc:390
{tmp/libexec/redpanda} 0x28192ca: std::__1::coroutine_handle<seastar::internal::coroutine_traits_base<seastar::bool_class<seastar::stop_iteration_tag>>::promise_type>::resume() const at /vec
torized/llvm/bin/../include/c++/v1/__coroutine/coroutine_handle.h:168
 (inlined by) seastar::internal::coroutine_traits_base<seastar::bool_class<seastar::stop_iteration_tag>>::promise_type::run_and_dispose() at /vectorized/include/seastar/core/coroutine.hh:78
{tmp/libexec/redpanda} 0x665b9df: seastar::reactor::run_tasks(seastar::reactor::task_queue&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:2557
 (inlined by) seastar::reactor::run_some_tasks() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3020
{tmp/libexec/redpanda} 0x665f657: seastar::reactor::do_run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3189
{tmp/libexec/redpanda} 0x665ca29: seastar::reactor::run() at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/reactor.cc:3072
{tmp/libexec/redpanda} 0x6572411: seastar::app_template::run_deprecated(int, char**, std::__1::function<void ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-template.
cc:265
{tmp/libexec/redpanda} 0x657052f: seastar::app_template::run(int, char**, std::__1::function<seastar::future<int> ()>&&) at /v/build/v_deps_build/seastar-prefix/src/seastar/src/core/app-temp
late.cc:156
{tmp/libexec/redpanda} 0x20aeebe: application::run(int, char**) at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-06879a8c75b58e683-1/redpanda/redpanda/src/v/redpanda/application
.cc:349
{tmp/libexec/redpanda} 0x698e3b9: main at /var/lib/buildkite-agent/builds/buildkite-amd64-builders-i-06879a8c75b58e683-1/redpanda/redpanda/src/v/redpanda/main.cc:22
{/opt/redpanda/lib/libc.so.6} 0x2d58f: ?? at ??:0
{/opt/redpanda/lib/libc.so.6} 0x2d648: ?? at ??:0
{tmp/libexec/redpanda} 0x20a9324: _start at ??:0

JIRA Link: CORE-1305

github-actions[bot] commented 5 months ago

This issue hasn't seen activity in 3 months. If you want to keep it open, post a comment or remove the stale label – otherwise this will be closed in two weeks.

github-actions[bot] commented 2 months ago

This issue hasn't seen activity in 3 months. If you want to keep it open, post a comment or remove the stale label – otherwise this will be closed in two weeks.

github-actions[bot] commented 1 month ago

This issue was closed due to lack of activity. Feel free to reopen if it's still relevant.