-
Hi
I'm trying to use spark-highcharts with structured streaming DataFrame as below (spark 2.1.0, zeppelin 0.7):
```
import com.knockdata.spark.highcharts._
import com.knockdata.spark.highcharts.…
-
**Context**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
Yes
**Problem description**
Latest Apache Hudi release (0.14.0) are using kafka-avro-serializer-5.3.4.jar, w…
-
Hi all,
Sometimes we need to suspend for a short time a running spark. Maybe to manipulate a kafka consumer group, or to prepare some elastic/cassandra/mongo/... entities, or any other operations n…
-
-
### Job Duties of a Senior DevOps Engineer SRE Lead in the CDA Team (Prioritized)
1. **System Architecture and Design:** Design and implement scalable, high-performance, highly available infrastructu…
-
Streaming sources in Spark emit [backlog metrics](https://docs.databricks.com/en/structured-streaming/stream-monitoring.html#streamingquerylistener-object-metrics) that indicate how behind a stream is…
-
Trembita currently is able to read data from kafka using Akka Stearms or Spark Streaming.
Need to research the ability to integrate Kafka streams directly so that users can use trembita without akka o…
-
The current approach of adding `SPARK_HOME` as a SBT subproject makes it difficult to properly change Spark versions, since it makes it very easy to wind up using assembly JARs that were built against…
-
### Search before asking
- [X] I had searched in the [issues](https://github.com/apache/seatunnel/issues?q=is%3Aissue+label%3A%22bug%22) and found no similar issues.
### What happened
When I use M…
-
Hi,
I'd like to consume/**read** data from ES via spark structured streaming.
The only possible solution I know today is via a workaround by using a combination of logstash and kafka
(`ES -> log…