NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
44 stars 34 forks source link

Fix internal predict CLI and remove preprocessed argument #1093

Closed leewyang closed 3 weeks ago

leewyang commented 3 weeks ago

This PR fixes the internal predict CLI and cleans up the external predict API.

Changes

  1. Allow --eventlogs argument in internal _predict_cli API.
  2. Remove --preprocessed argument from external predict API, since it's no longer used.

Test

Following CMDs have been tested:

External Usage:

spark_rapids prediction -p $PLATFORM -q $QUAL -o $OUTPUT 

Internal Usage:

python qualx_main.py predict
python qualx_main.py evaluate