-
Estimated Time: 8 weeks
Tasks and Detailed Requirements:
1. Implement Low-Latency Data Processing Pipeline:
○ Time: 4 weeks
○ Tools Required: Apache Kafka, Spark Streaming (within Azure)
○…
zepor updated
1 month ago
-
Hello there, I am trying to stream data from Kafka v2.5.0 with Spark v2.4.5 and SparklyR v1.2.
I am getting an error: **Error in stream_validate(.) : java.lang.AbstractMethodError**
when I try to se…
-
https://www.tutorialspoint.com/apache_kafka/apache_kafka_integration_spark.htm
https://spark.apache.org/docs/2.1.0/streaming-kafka-integration.html
-
### Apache Iceberg version
1.2.1 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
I got `The Spark SQL phase optimization failed with an internal error. Please, fill a bug r…
-
> 제가 자주 사용하는 Spark 라는 Framework를 소개해보았습니다.
> 이전 글들과는 다르게 사용해보시지 않으셨으면 조금 어려울 수도 있는 내용이 많습니다.
> 혹시나 관심있어서 들어오셨는데, 내용이 부실하여 이해가 잘 안되신다면 편하게 코멘트 부탁드립니다~
> 피드백은 언제나 환영입니다. 👋
![쉐보레 스파크](https://gith…
-
Originally asked at https://stackoverflow.com/questions/76392397/got-org-apache-kafka-common-errors-timeoutexception-topic-xxx-not-present-in-m
I am wondering could it be related to this library th…
-
This can either be 1 Spark job or different Python script that we can run from bash or a coordinating script.
-
### Apache Iceberg version
1.5.0 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
When using spark readStream the option `stream-from-timestamp` is used to position…
-
### Is your feature request related to a problem?
This meta-issue is for the `Spark Streaming` epic by which we plan to add spark streaming support in Ibis.
This issue is meant to contain general …
-
I am using spark-notebook with spark 2.1.1 and kafka 0.10.
the notebook can not find class on the runtime.
below is the log.
Thanks...
```
org.apache.kafka.common.KafkaException: Failed to co…