NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
44 stars 34 forks source link

Refactor ProfileResult classes to implement new interface design and add CSV output to Qual Tool #1043

Closed parthosa closed 1 month ago

parthosa commented 1 month ago

Fixes #1041.

1000 introduced a new interface design for calculating ProfileResults types. This enabled qualification tools to generate these results as part of the raw_metrics folder.

This PR refactors the calculation of the remaining ProfileResult types to follow the same design pattern. These files are needed by the estimation model. This is a step toward using only the qualification tool for the estimation model.

Files generated by Qual Tool

Changes:

Java/Core

Testing: