NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
44 stars 34 forks source link

[FEA] Profiler should dump all SQL metrics #1081

Closed tgravescs closed 2 days ago

tgravescs commented 4 weeks ago

Is your feature request related to a problem? Please describe. It was brought to my attentions that the profiler output in table "SQL Plan Metrics for Application"" is only dumping a specific set of SQL metrics. We should be dumping all the metrics we see so that they can be used for debugging/tuning.

parthosa commented 4 weeks ago

Should this change also reflect in the metrics generated by qualification tool?