Closed parthosa closed 1 month ago
Fixes #909.
We want to import the training module from QualX and update the prediction code with latest changes. This will be done in four steps.
train
spark-rapids-tools-1049-base
spark-rapids-tools-1049-plug-qualx
qualx
spark-rapids-tools/user_tools/src/spark_rapids_tools/tools/qualx
spark-rapids-tools/user_tools/src/spark_rapids_pytools/resources/qualx/models/xgboost
LGTM
Fixes #909.
We want to import the training module from QualX and update the prediction code with latest changes. This will be done in four steps.
Steps
train
by adding a new CMD for training.Note:
spark-rapids-tools-1049-base
has original code imported as it is (Step 1). Commit - https://github.com/NVIDIA/spark-rapids-tools/commit/757775ec9478bc24626ea219f63b60f14bb0bc69spark-rapids-tools-1049-plug-qualx
makes relevant changes inqualx
so that we can plug it with tools.Directory structure for QualX:
spark-rapids-tools/user_tools/src/spark_rapids_tools/tools/qualx
spark-rapids-tools/user_tools/src/spark_rapids_pytools/resources/qualx/models/xgboost
Test: