Print out the current batch size when OOM

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs

https://nvidia.github.io/spark-rapids

Apache License 2.0

822 stars 235 forks source link

Print out the current batch size when OOM #11733

Open firestarman opened 2 days ago

firestarman commented 2 days ago

closes https://github.com/NVIDIA/spark-rapids/issues/11732

This PR adds the support to print out the size of the data being processed when OOM happens in the retry block. This is designed for the better OOM issues triage.

firestarman commented 2 days ago

build

firestarman commented 1 day ago

build