-
# Kafka 0.10.0 not working with Almond
Kafka as a streaming data source is not detected when using `spark-sql-kafka-0-10` with Almond as per https://spark.apache.org/docs/2.4.3/structured-streaming-k…
-
**Describe the bug**
When a field is using custom remapping via Data Model, then creating Models will make the query fail.
Workaround: Use a database view, or try using SQL with manual remapping (…
-
scala> var streamingQuery = streamingQueryWriter.start()
streamingQuery: org.apache.spark.sql.streaming.StreamingQuery = org.apache.spark.sql.execution.streaming.StreamingQueryWrapper@1822f675
18/…
-
### What motivated this proposal?
I really like this library and want it to succeed. However, while trying to contribute I'm feeling significant technical debt on how options are passed in the code…
-
### Configuration
We have a list of libraries defined like that
```hcl
databricks_libraries_cluster_247 = [ "confluent-kafka==2.5.3"
, "opencensus-ext…
-
There are 3 options in GA4 to export data to Bigquery -> Daily, Fresh Daily and Streaming.
Enabling Daily creates sharded tables called events_*
Enabling Fresh Daily creates sharded tables called…
-
I get this exception seemingly randomly, in different locations in my code. All of them are when I'm trying to _read_ from Redshift using a query, into a Spark DataFrame.
The extra bizarre thing i…
-
I get NoSuchMethodError while trying to read message from pubsublite using spark structured streaming application.
```
2023-05-30 11:15:05,024 [INFO ] [84] org.apache.spark.sql.execution.streaming.…
-
**Bug Report:**
**Description:** Spark Scala streaming application reads dataset from EventHub and writes processed dataset to ADLS Gen2, that part of the application (without hadoop configuration)…
-
> suggsted by YaoCheng.
Timeplus is a streaming-first data analytics platform. It provides powerful end-to-end capabilities to help teams process streaming and historical data quickly and intuitive…