search

NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
49 stars 36 forks source link

Handling FileNotFound exception in AutoTuner #1065

Closed bilalbari closed 3 months ago

bilalbari commented 4 months ago

Fixes #978

This fix handles the AutoTuner exception when an input file passed as workerInfo arguments does not exist.

Changes -

  1. Catching the FileNotFound exception and adding a warning for it.
  2. As well as appending a tuner comment which conveys this
  3. Minor change to handle NonFatal exception while building AutoTuner from props