-
**Is your feature request related to a problem?**
When working with Iceberg tables in Spark streaming jobs, the stream will terminate with an error if there are updated or deleted rows in the Icebe…
-
**Describe the problem you faced**
Writes to a Hudi Table in S3 fail due to a FileNotFoundException on the archived folder under the `.hoodie` directory. I've verified that the file does exist in S…
-
### **Describe the feature**
The feature adds the ability to automatically generate SQL column comments in Databricks Delta Live Tables (DLT). Specifically, it updates the `CREATE STREAMING TABLE` SQ…
-
I am using streamnative's Apache Pulsar connector version `3.4.4.1` with spark dependencies version `3.4.1`. When submitting the spark app on console, I am getting below error.
```java
Exception…
-
**Environment Description**
* Hudi version : 0.15.0
* Spark version : 3.5.1
* Hive version : no
* Hadoop version : 3.1.3
* Storage (HDFS/S3/GCS..) : HDFS
* Running on Docker? (yes/no…
-
Hello,
I am trying to update my application to spark 3.5.1 (Scala version 2.12.18, OpenJDK 64-Bit Server VM, 17.0.10) but the scala 2.12 connector keeps throwing this error.
While trying to str…
-
**Is your feature request related to a problem? Please describe.**
https://news.ycombinator.com/item?id=20059006
Some of the comments
`I am doing most of the stuff mentioned in that paper right …
-
### Query engine
- Spark 3.5
- Iceberg 1.5.2
- Azure storage account ABFSS
### Question
I’m trying to use the `MERGE INTO` statement within a Spark streaming application that runs several s…
-
### Search before asking
- [X] I had searched in the [feature](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22Feature%22) and found no similar feature requirement.
### Descripti…
-
Hi all, how do I get Spark.jl to read a stream from and write to Kafka? I need help finding documentation on that.