-
**Used Spark version**
2.3.2
**Used Spark Job Server version**
(Released version, git branch or docker image version)
0.8
**Deployed mode**
(client/cluster on Spark Standalone/YARN/Mesos/EMR or …
-
Hi,
I´m trying to run an application that receive stream from kafka, but i´m facing the follow error:
D:\Spark\spark-clr_2.11-2.0.200\runtime\scripts>sparkclr-submit.cmd debug --jars D:\Spark\s…
-
**Describe the problem you faced**
Hi Hudi community, I have a glue job that is ingesting data to a Hudi MOR table. However, this job periodically failed in the below stage
Could you help …
-
I know DL4J can be used on spark
However I am not sure can the DL4J be used on Spark Streaming or Flink?
Thank You
-
### Is your feature request related to a problem?
Windowing functions are not supported in Pyspark backend right now.
### Describe the solution you'd like
I'd like to have support for windowi…
-
We are running spark application, which receives data form rabbitmq as stream. We are observing below issue after 8 hours (duration is not constant, some time after 24 hours also).
Below excepti…
-
# Problem Statement
As the title suggests, when a Spark job is running in a streaming configuration that performs a Kafka-to-Kafka data flow, the integration fails to emit any events with inputs an…
d-m-h updated
11 months ago
-
java.lang.Exception: org.apache.spark.streaming.dstream.MappedDStream@6c1e5044 has not been initialized
at org.apache.spark.streaming.dstream.DStream.isTimeValid(DStream.scala:264)
at org.apac…
-
## Bug
### Describe the problem
When delta lake + Structured Streaming is writing azure storage gen2, after a period of normal operation, the streaming query stream is suddenly in the finished s…
-
Hi,
I love your PoC repo, it gives a great overview of how to use streaming in zeppelin.
Thanks for publically sharing this!
It currently does have one issue though, hopefully you know more on ho…