NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
44 stars 34 forks source link

[BUG] QualX fails to detect profiling metrics for non-standard App IDs #1163

Closed parthosa closed 3 days ago

parthosa commented 5 days ago

QualX assumes App IDs start with app* and uses this regex pattern to fetch profiling metrics. However, App IDs can be any alphanumeric string. In that case QualX will not be able to detect the profiling metrics folder, causing the tool to fallback to legacy speedups.

We should improve the regex to be more generic.