-
While doing spark-submit for the realtime dashboard application, i get following error 👍
spark@spark-in-action:~/uc1-docker$ ./run-all.sh
Zookeeper already started
Kafka already started
sia-dashb…
-
Hi,
I love your PoC repo, it gives a great overview of how to use streaming in zeppelin.
Thanks for publically sharing this!
It currently does have one issue though, hopefully you know more on ho…
-
Hi Team,
I am trying to create a Spark Application for streaming the messages from Azure EventHub (Kafka). Here is my use case.
Read the messages from EventHub (on a specific topic) periodically…
-
### First,I think we need to include Python Most Used Libraries like **Pandas, Matplotlib, Scikit-learn, Seaborn, Plotly**.
Pandas and Matplotlib Cheatsheet is a big necessary right now for the Pyt…
-
Hello, I'm using the `Spark 2.4.1` image, I made a simple scala application that pulls data from a kafka topic and displays it in the console:
```
import org.apache.spark.sql._
import org.apache.…
-
Application dependencies added using the `deps.packages` seem to be ignored. It should work according to the [docs](https://github.com/GoogleCloudPlatform/spark-on-k8s-operator/blob/master/docs/user-g…
-
**Purpose:**
Currently, by default, we see lot of OpenLineage related logs in the actual Spark Job - when we integrate OpenLineage to the spark-submit command. This is especially a lot when transport…
-
I was using abris with confluent schema registry to deserialize avro records received from kafka source.
When i use confluent schema registry and manually get the schema and pass it to spark default…
-
-
Hi All,
I want to know the correct approach for sending the json data kafka to spark stream. i am creating the one kafka topic (in java) after running the program, what is the exact way to s…