apache / datafusion-ballista

Apache DataFusion Ballista Distributed Query Engine
https://datafusion.apache.org/ballista
Apache License 2.0
1.46k stars 185 forks source link

Fix plan metrics length and stage metrics length not match #763

Closed yahoNanJing closed 1 year ago

yahoNanJing commented 1 year ago

Describe the bug

We got lots of error log as follows due to mismatch of the length between plan metrics and stage metrics: 2023-04-27T07:08:05.745787Z ERROR tokio-runtime-worker ThreadId(07) ballista_scheduler::display: Fail to combine stage metrics to plan for stage [5H4NLbc/3], plan metrics array size 5 does not equal to the stage metrics array size 4

To Reproduce

Expected behavior

Additional context