NVIDIA / spark-rapids-jni

RAPIDS Accelerator JNI For Apache Spark
Apache License 2.0
41 stars 66 forks source link

Introduce kudo reader. #2578

Closed liurenjie1024 closed 1 week ago

liurenjie1024 commented 2 weeks ago

This pr is part of https://github.com/NVIDIA/spark-rapids-jni/pull/2532 , which introduces reader part of kudo format.

liurenjie1024 commented 2 weeks ago

Blocked by https://github.com/rapidsai/cudf/pull/17265

abellina commented 2 weeks ago

I will review this today as well

liurenjie1024 commented 2 weeks ago

build

liurenjie1024 commented 2 weeks ago

The blossom ci failure is know issue, due to failure sync of cudf.

liurenjie1024 commented 2 weeks ago

build

pxLi commented 2 weeks ago

build

pxLi commented 2 weeks ago

re-kicked, previous trigger failed due to github server-side reset the connection

Received RST_STREAM: Stream not processed
liurenjie1024 commented 1 week ago

cc @jlowe @abellina PTAL. If there is not major block issue, could we merge this first so that I can start work of integrating with spark-rapids? Minors issues could be resoved in parallel.

liurenjie1024 commented 1 week ago

build