-
While doing spark-submit for the realtime dashboard application, i get following error 👍
spark@spark-in-action:~/uc1-docker$ ./run-all.sh
Zookeeper already started
Kafka already started
sia-dashb…
-
Whenever we try to connect to kafka, we get this error:
WARNING:root:kafka dataframe could not be created because: An error occurred while calling o36.load.
: java.lang.NoClassDefFoundError: scala/…
-
On upgrading to spark-streaming-kafka to 0-10_2.12, compilation is failing with the following error
[INFO] /home/svs/install/HiBench/sparkbench/streaming/src/main/scala:-1: info: compiling
[INFO] …
-
### Apache Iceberg version
1.5.0
### Query engine
Spark
### Please describe the bug 🐞
We're running Iceberg with Spark, using Spark Structured Streaming to read from a Kafka topic and write to an…
-
Hello.
I noticed that the `divolteStream` uses `createStream` method of `KafkaUtils` to establish a stream, however since Spark 1.3 it is recomended to use [DirectStream API](http://spark.apache.org/d…
-
Hi all :wave:
I'm using Spark Structured Streaming to stream from one Hudi table to another Hudi table.
I noticed that when stream started for the first time, each batch was relatively fast, with an…
-
## Expected Behavior
Feast should let Spark Structured Streaming to process messages from the earliest offset of Kafka.
## Current Behavior
Feast only lets Spark Structured Streaming to proc…
-
I'm getting this error:
```
>>> directKafkaStream = KafkaUtils.createDirectStream(ssc, ["help_center.activity.events"], {"metadata.broker.list": "kafka.service.consul:9092"})
_______________________…
dasch updated
7 years ago
-
Per your instructions I created the kafka topic "wordcount" and populated it with messages. I had to do it manually as your producer also gave runtime error. But the main issue was the spark streamin…
-
Spark 1.3 introduced a new direct approach for integrating Kafka and Spark Streaming (without receivers). It has several advantages, as explained here:
https://spark.apache.org/docs/1.3.1/streaming-k…