-
https://www.oolongbox.com/box/2c3ea3f5/
Spark——Structured streaming + hive sink
-
Hello,
I want to use spark-structured-streaming to process data fetched from kafka messages, and then store as rows cassandra database.
I need one clarification.
The message in kafka are serializ…
-
### Apache Iceberg version
1.2.0 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
According to the documentation, when using Iceberg, one should set `spark.sql.extensions` to…
-
Bug Report:
Spark structured streaming with databricks spark ends up with `java.util.concurrent.TimeoutException: Futures timed out after [5 minutes]`
- Actual behavior: Ends up in the above menti…
-
### Apache Iceberg version
1.4.0
### Query engine
Spark
### Please describe the bug 🐞
We use spark structured streaming to consume avro message from kafka and write them to iceberg tables, see fo…
-
Hi
I'm trying to use spark-highcharts with structured streaming DataFrame as below (spark 2.1.0, zeppelin 0.7):
```
import com.knockdata.spark.highcharts._
import com.knockdata.spark.highcharts.…
-
### What kind an issue is this?
- [X] Feature Request.
### Feature description
When using ILM (index lifecycle management) and its roll over API implementation, your ingest job needs to point at …
-
Somewhere in there you are probably dropping down into RDD apis.
-
At the moment, Spark does not support window functions (like `lag` or `head`) on a stream.
It would be great if you could add support for those type of operation.
-
http://datahacker.me/2019/01/22/spark-sql-streaming-performance-profile/#more