NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
44 stars 34 forks source link

[DOC] Qualification docs emphasize cost savings, is that what we still want? #1026

Open tgravescs opened 1 month ago

tgravescs commented 1 month ago

Report incorrect documentation

Location of incorrect documentation the qualification tool docs emphasize cost savings and speedups, do we want to change this to be top level candidates type wording and say more about tuning and cluster config recommendations

amahussein commented 1 month ago

It is hard a call to decide to navigate way from Cost-savings because the requirements change over time. Previously, the tools CLI went back-and-forth on doing cost-savings by default Vs. give the option to disable it..

We are doing incremental changes to the Qualification Nvidia docs https://docs.nvidia.com/spark-rapids/user-guide/24.04/qualification/overview.html Eventually, there will be information about

Assigned it to @mattahrens to decide on whether TCO should be pushed down the documentation/removed.

mattahrens commented 1 month ago

I have merged in changes to the User Guide overview page for the qualification tool to highlight the aspects of qualification related to the list of qualified jobs as well as recommended configs and cluster shape and de-emphasized speedups.