search

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
806 stars 234 forks source link

[QST] Spark-SQL support is available ? #5234

Closed Manoj-red-hat closed 2 years ago

Manoj-red-hat commented 2 years ago

Most of the articles and blog always talk about SQL via dataframes approach, so just wondering Can I run SQL queries via spark-rapids[Spark-SQL shell] ?

SoumyaB57 commented 2 years ago

Yes we can do that just add the jar files and plugin when running spark-shell script

Manoj-red-hat commented 2 years ago

@SoumyaB57 Can I run that on @nvidia geforce gtx 1050 for learning purpose ?

jlowe commented 2 years ago

@Manoj-red-hat yes, it should run on a GTX 1050 because that uses the Pascal architecture. The RAPIDS Accelerator support the same GPUs as RAPIDS, see the RAPIDS Requirements page for details.

By the way, for future questions it would be great to use our new Discussions section.

Manoj-red-hat commented 2 years ago

Thanks @jlowe, will use that forum for further discussion