search

NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
44 stars 34 forks source link

sync w/ internal repo; update models #1083

Closed leewyang closed 4 weeks ago

leewyang commented 4 weeks ago

This PR syncs the migrated QualX code with the latest code from the internal repo.

Changes

  1. Fix failed stages handling.
  2. Ignore wholestagecodegen for unsupported.
  3. Use actual gpu app duration.
  4. Default to dMAPE metric.
  5. Add updated model json files.

Test

Following CMDs have been tested:

Internal Usage:

python qualx_main.py preprocess
python qualx_main.py train
python qualx_main.py evaluate