Admit coordinator-only "system queries" when required worker count not satisfied

trinodb / trino

Official repository of Trino, the distributed SQL query engine for big data, formerly known as PrestoSQL (https://trino.io)

https://trino.io

Apache License 2.0

10.21k stars 2.94k forks source link

Admit coordinator-only "system queries" when required worker count not satisfied #4130

Open findepi opened 4 years ago

findepi commented 4 years ago

Given coordinator with

node-scheduler.include-coordinator=false
query-manager.required-workers=1

query

select * from system.runtime.nodes;

will get into WAITING_FOR_RESOURCES state, waiting for a worker. However, once the worker shows up and query gets admitted, the query executes on coordinator only. We should not wait for a worker in this case.

Relates to: https://github.com/prestosql/presto/issues/4131

prakharcode commented 4 years ago

Hi, would like to take this up.

findepi commented 4 years ago

@prakharcode thanks! before starting to code this, let's have agreement if this is really what we want. cc @dain @sopel39 @martint

raunaqmorarka commented 4 years ago

Past discussion about this: https://github.com/prestosql/presto/pull/2484#discussion_r369927055

zach-overflow commented 2 years ago

+1 this would be a great enhancement.