delta-io / delta-rs

A native Rust library for Delta Lake, with bindings into Python

https://delta-io.github.io/delta-rs/

Apache License 2.0

1.97k stars 365 forks source link

Support HDFS via hdfs-native package #2611

Closed Kimahriman closed 1 week ago

Kimahriman commented 1 week ago

Description

hdfs-native is a Rust package I made that implements an HDFS client in pure* Rust. This can be used to add HDFS support to delta-rs without any Java or JVM dependencies.

*Kerberos support uses dynamic loading of libgssapi_krb5 via libloading

Use Case Using delta-rs with HDFS without requiring Java

Related Issue(s)

santosh-d3vpl3x commented 1 week ago

@Kimahriman is it possible to also add native hdfs support to delta-kernel-rs? Added a new issue for this feature