NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
43 stars 34 forks source link

[FEA] user tools qualification node recommendation should include the number of GPUs to use #1143

Open tgravescs opened 6 days ago

tgravescs commented 6 days ago

Is your feature request related to a problem? Please describe. We are recommending a node type to use qualification for migrating apps from cpu to gpu. We should also be recommended the number of GPUs to use with that. This will likely vary depending on the platform being used and it could also change the number of instances we recommend. For instance lets say cpu is using 64 core boxes with 8 execs on each. If on that CSP we can't get an 8 GPU machine perhaps we alter that to use 8 smaller machines.