NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
49 stars 36 forks source link

Handle QualX behaviour when Qual Tool does not generate any outputs #1095

Closed parthosa closed 3 months ago

parthosa commented 3 months ago

Fixes #1094.

In QualX, if there are no outputs from Qualification Tool, we raise an exception. The same exception will be thrown when there is no data after preprocessing. This is not ideal and we should differentiate the two cases.

This PR changes the behaviour:

Output:

Case: Qual Tool does not generate any output

WARNING spark_rapids_tools.tools.qualx.qualx_main: Qualification tool metrics are missing. Speedup predictions will be skipped.