-
Sparklens seem to be waiting for the job to complete, however it doesn't seem to be working with the
Spark streaming jobs. Do you have any plan to fix it ?
-
# Kafka 0.10.0 not working with Almond
Kafka as a streaming data source is not detected when using `spark-sql-kafka-0-10` with Almond as per https://spark.apache.org/docs/2.4.3/structured-streaming-k…
-
**Describe the bug**
When I chose "file system" the folders will be shown with their correct name.
But files will be shown with their track info tags instead of the file name.
**To Reproduce**
S…
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Is your feature request related to a problem? Please describe the problem.
As an AI engineer developing Genera…
-
**Describe the problem you faced**
Running Hudi offline clustering job for MoR tables on Hudi 0.14.0
Facing `org.apache.parquet.io.ParquetDecodingException: Failed to read 808583168 bytes` errors.…
-
I have a need to do XML parsing, both SAX (streaming tags) and structured tree data. Basing this on Foundation would be ideal. Does anyone have any plans in that area? My guess is unlike prettyprintin…
-
-
I'm using Azure Data Bricks and trying to read from the change feed with Spark Structured Stream:
spark.readStream.format("com.microsoft.azure.cosmosdb.spark").options(**streamingConfig).load()
Bu…
-
Hey! Your project is super cool and we are using it to draw inspiration for our own open source project.
We are trying to stream audio bidirectionally with a full-duplex websocket with STT and TTS wi…
-
I am trying to build a spark streaming application to ingest data from Azure Event Hubs and persist to a delta table in databricks.
I'm using the AvailableNow trigger in spark streaming.
This trigg…