search

NVIDIA / spark-rapids

Spark RAPIDS plugin - accelerate Apache Spark with GPUs
https://nvidia.github.io/spark-rapids
Apache License 2.0
822 stars 235 forks source link

[FEA] it would be nice if we could support org.apache.spark.sql.catalyst.expressions.Bin #11648

Open nvliyuan opened 1 month ago

nvliyuan commented 1 month ago

it would be nice if we could support org.apache.spark.sql.catalyst.expressions.Bin

Seq(1,2,3,4,5,6).toDF("a").repartition(1).createOrReplaceTempView("t1")
sql("select bin(a) from t1").show

! <Bin> bin(cast(a#19 as bigint)) cannot run on GPU because GPU does not currently support the operator class org.apache.spark.sql.catalyst.expressions.Bin
nvliyuan commented 1 month ago

low priority

revans2 commented 1 month ago

Would probably need a new kernel for this, but it is just taking a long and outputting the binary representation of it, which should be dead simple to do.