apache / incubator-gluten

Gluten is a middle layer responsible for offloading JVM-based SQL engines' execution to native engines.
https://gluten.apache.org/
Apache License 2.0
1.22k stars 438 forks source link

[GLUTEN-7969][VL] Enable spill to multiple directories for micro benchmark #7970

Closed marin-ma closed 5 days ago

github-actions[bot] commented 6 days ago

https://github.com/apache/incubator-gluten/issues/7969

FelixYBW commented 6 days ago

Current microbenchmark reports errors when the spill folder and file already exists. Can we remove the spill files once benchmark complete?