[Feature Request] Clarification on docs needed to not confuse users with Spark-delta and Delta-RS

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

7.65k stars 1.72k forks source link

[Feature Request] Clarification on docs needed to not confuse users with Spark-delta and Delta-RS #2225

Open ion-elgreco opened 1 year ago

ion-elgreco commented 1 year ago

Feature request

Currently there are two connectors in Python that allow you to interact with Delta lake.

Spark-Delta, which requires spark
Deltalake (delta-rs python bindings)

We may need to make it clearer on the Delta.io docs page that the python implementation is only for PySpark. Currently when you google python delta you get these results:

astrojuanlu commented 6 days ago

This just happened to us. When somebody goes from https://delta.io/ to "Docs", they land on https://docs.delta.io/latest/index.html, and there's no indication delta-rs exists.

Then if somebody does a Cmd+F of "Python" on that page, there's absolutely nothing.

And if one searches for Rust, they find (1) the "Delta Kernel Rust" page (empty) and (2) a link to the deltalake Rust library, but no mention of delta-rs either.