[Infra] [Spark] [Do Not Merge] Reduce delta-spark CI test runtime (20 shards)

delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs

https://delta.io

Apache License 2.0

7.63k stars 1.71k forks source link

[Infra] [Spark] [Do Not Merge] Reduce delta-spark CI test runtime (20 shards) #3725

Open scottsand-db opened 2 months ago

scottsand-db commented 2 months ago

Which Delta project/connector is this regarding?

[ ] Spark
[ ] Standalone
[ ] Flink
[ ] Kernel
[ ] Other (fill in here)

delta-io / delta

[Infra] [Spark] [Do Not Merge] Reduce delta-spark CI test runtime (20 shards) #3725

Which Delta project/connector is this regarding?

Description

How was this patch tested?

Does this PR introduce any user-facing changes?