NVIDIA / spark-rapids-tools

User tools for Spark RAPIDS
Apache License 2.0
44 stars 34 forks source link

[BUG] Qual tool platform databricks-aws-t4 print out - GPU device is missing. Setting default to a10G #1030

Closed tgravescs closed 1 month ago

tgravescs commented 1 month ago

Describe the bug I passed the platform argument of databricks-aws-t4... which indicates gpu is t4 but in the output it printed:

- GPU device is missing. Setting default to a10G.
- GPU memory is missing. Setting default to 24576m.

But at the same time also printed:

--conf spark.rapids.sql.concurrentGpuTasks=2 which indicates T4, because A10G should be concurrent 3