[FEA] Add retry support when partitioning batches for the sub hash join.

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

https://nvidia.github.io/spark-rapids

Apache License 2.0

822 stars 235 forks source link

[FEA] Add retry support when partitioning batches for the sub hash join. #11705

Closed firestarman closed 2 weeks ago

firestarman commented 2 weeks ago

In the method partitionBatches of GpuBatchSubPartitioner, it has a retry for the partitioning computation, but no retry for the table splitting operation. It would be better to also add retry support for the table splitting.