-
It would be great to support `SHOW PARTITIONS` in Delta so that people can check the partition values in a table. Output example,
```
spark.range(1, 10).selectExpr("id as c1", "current_date() as c…
-
Hello, I'm using the `Spark 2.4.1` image, I made a simple scala application that pulls data from a kafka topic and displays it in the console:
```
import org.apache.spark.sql._
import org.apache.…
-
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/incubator-seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
I …
-
The integration tests on Dataproc Serverless are encountering failures, with some tests failing completely and others partially. The error messages and stack traces from these failures are captured in…
-
I get NoSuchMethodError while trying to read message from pubsublite using spark structured streaming application.
```
2023-05-30 11:15:05,024 [INFO ] [84] org.apache.spark.sql.execution.streaming.…
-
The way Delta is designed it is not tied to a particular storage format. The storage format can also be abstracted out just like the storage. If the file format is made configurable, Delta's capabilit…
-
Hi Jdbc2S team,
Thank you so much for this repo.
I'm working on a personal project where I need to fetch real-time data from the Database using Spark Structured Streaming API.
I tried 2 approach…
-
Subscribe to this issue and stay notified about new [daily trending repos in Scala](https://github.com/trending/scala?since=daily)!
-
### Motivation
To paraphrase the [design doc](https://docs.google.com/document/d/112VsrCKhtqtUTph5yXMzsaoxtz9wX1U2poi1vxuDswY/edit#), Druid is an excellent OLAP tool that aims to serve real-time an…
-
### Version
main branch
### Describe what's wrong
spark connector create hive table from dataframe failed for partition schema check, because `favorite_color` is not the last column in datafr…