search

NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
44 stars 34 forks source link

Port QualX repo and add CLI for train #1076

Closed parthosa closed 4 weeks ago

parthosa commented 4 weeks ago

Issue: #909, #1049

We want to import the training module from QualX and update the prediction code with latest changes. This was done in four steps.

Steps

  1. Import the source code and pretrained models as it as. Exclude these from pytest and flake8 linters.
  2. Make changes in the qualx files to connect them with tools.
  3. Make changes in the tools to use the latest changes in qualx.
  4. Add entry point for train by adding a new CMD for training.

This PR is merges the feature branch with above changes to dev. Refer to individual PRs for more details: