search

ydb-platform / ydb

YDB is an open source Distributed SQL Database that combines high availability and scalability with strong consistency and ACID transactions
https://ydb.tech
Apache License 2.0
4.02k stars 581 forks source link

tpch10000 q5 grace join memlimit. nothing spilled #11412

Open lll-phill-lll opened 1 week ago

lll-phill-lll commented 1 week ago

Got OOM during nighly run in TPCH10000 q5 in grace join: https://proxy.sandbox.yandex-team.ru/7425151036/index.html#suites/fd4dd690a9ee7ddce6d52cd9527face7/13c19cd0b8d96fa6/

According to the svg plan spilling was not spilling Image

lll-phill-lll commented 1 week ago

same here: https://proxy.sandbox.yandex-team.ru/7424952174/index.html#suites/83a7db6541269867a604826f8b4fa5ca/9d2294ec81b4fa25/

lll-phill-lll commented 1 week ago

Fresh run: https://proxy.sandbox.yandex-team.ru/7446727520/index.html#suites/fd4dd690a9ee7ddce6d52cd9527face7/191244b9e971da06/

spilling is presented. But still memlimit Image

BT: https://paste.yandex-team.ru/3cf690d7-207d-4aa2-b6d5-4c7665f9deb1

https://github.com/ydb-platform/ydb/blob/519686a2ae37c12029c76f05a9069b18564510b1/yql/essentials/minikql/comp_nodes/mkql_grace_join_imp.cpp#L1221