delta-io / delta

An open-source storage framework that enables building a Lakehouse architecture with compute engines including Spark, PrestoDB, Flink, Trino, and Hive and APIs
https://delta.io
Apache License 2.0
7.49k stars 1.68k forks source link

[BUG]shadedDelta not found in 3.0.0rc2 distro #2165

Closed bvkiran closed 7 months ago

bvkiran commented 11 months ago

Bug

I am trying to use the rc2 build with this sbt ThisBuild / scalaVersion := "2.13.12"

resolvers += "Delta OSS Snapshots" at "https://oss.sonatype.org/content/repositories/iodelta-1120/"

lazy val sparkVersion = "3.5.0"

lazy val root = (project in file(".")) .settings( name := "TestDelta" ) val scalatestVersion = "3.2.17"

libraryDependencies ++= Seq( "org.apache.spark" %% "spark-core" % sparkVersion, "org.apache.spark" %% "spark-sql" % sparkVersion, "org.scalatest" %% "scalatest" % scalatestVersion % "test", "io.delta" %% "delta-spark" % "3.0.0rc2" withSources(), "io.delta" %% "delta-iceberg" % "3.0.0rc2" withSources() )

When I run with iceberge compatability, I get java.lang.NoClassDefFoundError: shadedForDelta/org/apache/iceberg/types/Type$PrimitiveType

Which Delta project/connector is this regarding?

Describe the problem

Steps to reproduce

Observed results

Expected results

Further details

Environment information

Willingness to contribute

The Delta Lake Community encourages bug fix contributions. Would you or another member of your organization be willing to contribute a fix for this bug to the Delta Lake code base?

scottsand-db commented 11 months ago

Yup! Thanks! Please see https://github.com/delta-io/delta/pull/2166

scottsand-db commented 7 months ago

Closed by https://github.com/delta-io/delta/pull/2166