-
Estimated Time: 8 weeks
Tasks and Detailed Requirements:
1. Implement Low-Latency Data Processing Pipeline:
○ Time: 4 weeks
○ Tools Required: Apache Kafka, Spark Streaming (within Azure)
○…
zepor updated
1 month ago
-
Hello there, I am trying to stream data from Kafka v2.5.0 with Spark v2.4.5 and SparklyR v1.2.
I am getting an error: **Error in stream_validate(.) : java.lang.AbstractMethodError**
when I try to se…
-
https://www.tutorialspoint.com/apache_kafka/apache_kafka_integration_spark.htm
https://spark.apache.org/docs/2.1.0/streaming-kafka-integration.html
-
This can either be 1 Spark job or different Python script that we can run from bash or a coordinating script.
-
Originally asked at https://stackoverflow.com/questions/76392397/got-org-apache-kafka-common-errors-timeoutexception-topic-xxx-not-present-in-m
I am wondering could it be related to this library th…
-
### Apache Iceberg version
1.5.0 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
When using spark readStream the option `stream-from-timestamp` is used to position…
-
> 제가 자주 사용하는 Spark 라는 Framework를 소개해보았습니다.
> 이전 글들과는 다르게 사용해보시지 않으셨으면 조금 어려울 수도 있는 내용이 많습니다.
> 혹시나 관심있어서 들어오셨는데, 내용이 부실하여 이해가 잘 안되신다면 편하게 코멘트 부탁드립니다~
> 피드백은 언제나 환영입니다. 👋
![쉐보레 스파크](https://gith…
-
I am using spark-notebook with spark 2.1.1 and kafka 0.10.
the notebook can not find class on the runtime.
below is the log.
Thanks...
```
org.apache.kafka.common.KafkaException: Failed to co…
-
### Is your feature request related to a problem?
This meta-issue is for the `Spark Streaming` epic by which we plan to add spark streaming support in Ibis.
This issue is meant to contain general …
-
Hi,
I´m trying to run an application that receive stream from kafka, but i´m facing the follow error:
D:\Spark\spark-clr_2.11-2.0.200\runtime\scripts>sparkclr-submit.cmd debug --jars D:\Spark\s…