search

apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.46k stars 185 forks source link

Fix plan metrics length and stage metrics length not match #764

Closed yahoNanJing closed 1 year ago

yahoNanJing commented 1 year ago

Which issue does this PR close?

Closes #763.

We got lots of error log as follows due to mismatch of the length between plan metrics and stage metrics: 2023-04-27T07:08:05.745787Z ERROR tokio-runtime-worker ThreadId(07) ballista_scheduler::display: Fail to combine stage metrics to plan for stage [5H4NLbc/3], plan metrics array size 5 does not equal to the stage metrics array size 4

The metrics length of stage is always one less than the one of plan.

Rationale for this change

It's caused by #687.

What changes are included in this PR?

Are there any user-facing changes?

yahoNanJing commented 1 year ago

Hi @andygrove, could you help have a check?

r4ntix commented 1 year ago

I also found this issue today and am locating it, glad to see that there is already a PR fix for this issue 👍