-
When `checkpointLocation` is set, resuming execution fails with:
```
osmesa.common.streaming.AugmentedDiffMicroBatchReader@59e19287
at org.apache.spark.sql.execution.streaming.StreamExecution.or…
-
**Describe the problem you faced**
We are trying to POC Hudi with our existing streaming job which consumes from AWS Kinesis Data Stream, and deliver as parquet in S3. The job is running continuously…
-
I am using spark-notebook with spark 2.1.1 and kafka 0.10.
the notebook can not find class on the runtime.
below is the log.
Thanks...
```
org.apache.kafka.common.KafkaException: Failed to co…
-
@ouyangshourui, @keepsimplefocus, @jacksu, @klion26, @zzcclp, @tsface, @endymecy, @wongxingjun, @luphappy, @pzz2011, @TopSpoofer
Hi all，大家在《Spark Streaming 源码解析系列》github 上有过挺多交流，让我们搞个微信群？:-)
麻烦各位先…
-
Whenever we try to connect to kafka, we get this error:
WARNING:root:kafka dataframe could not be created because: An error occurred while calling o36.load.
: java.lang.NoClassDefFoundError: scala/…
-
I am trying to get this library and not having any luck... Appreciate any help!
here is the code:
```
from pyspark.streaming import StreamingContext
from signifai.pubsub import PubsubUtils
from…
-
### Apache Iceberg version
1.2.1
### Query engine
Spark
### Please describe the bug 🐞
I'm using micro batch spark streaming read parquet file and writing to iceberg table. When writing …
-
This can either be 1 Spark job or different Python script that we can run from bash or a coordinating script.
-
In Streaming Analytics Manager, I want to replace the Storm with Spark Streaming. How to operate?
-
### Query engine
**Spark**
Using the [quick-start](https://iceberg.apache.org/spark-quickstart/) guide, I am adding Parquet files (in MinIO) to an Iceberg table.
### Question
Unless the hado…
tj--- updated
2 weeks ago