Open hackeryang opened 8 months ago
Could you try this with a more recent release ? This should be improved by https://github.com/trinodb/trino/pull/18862 cc: @losipiuk
@hackeryang actually it will not improve yet. We have all the needed changes in scheduler - but we also need changes to exchange implementation. Filesystem based exchange still requires work.
Hello dear community, I executed a query with the fault tolerant execution mode in Trino 423:
However, I found that this query didn't finish quickly with 100 rows, and try to scan over the whole table.
I roughly understand the cause of this phenomenon, it may be because the MPP architecture needs the coordinator(i.e. Stage 0) to decide the termination of splits scheduling, and the fault tolerant execution mode won't let the coordinator see 100 rows immediately just like the streaming pipeline execution before.