-
Hello @djuang1 , it's really handy component for mule use to change formats. While the filesystem file convert fine, I constantly get errors while using the streaming function, I'm attaching the error…
-
Hi,
I am facing an issue with Spark job, which is reading streaming data from Azure Event Hub and storing the data in ADL(Azure Data Lake) Gen1 file system.
Spark Version: 3.0.0
Please help …
-
After we supported batch source read and reuse several concepts in RW, it is crucial that users can easily differentiate them and understand the different semantics of various SQL statements, i.e. str…
lmatz updated
3 months ago
-
Hello everyone,
We have one spark streaming 24/7 using Hudi COW, we use Spot instances, so, sometimes the machine crash and the streaming is started again. Our source is Kafka.
Hudi: 0.12.1
EMR…
-
Issue in ./help/using/building-journeys/update-profiles.md
We've run into a few customer issues where additional clarity in this doc could have prevented some issues. Here are the recommended updat…
-
Hi All,
I am using StreamingLens in my spark structure streaming application but it's always showing same logs .BatchId is getting updated but **Streaming Query State: NONEWBATCHES** remains same.…
-
### Apache Iceberg version
1.5.1 (latest release)
### Query engine
Flink
### Please describe the bug 🐞
ADLSFileIO has an AzureProperties object. When ADLS_SHARED_KEY_ACCOUNT_NAME or ADLS_SHARED_K…
-
### Apache Iceberg version
1.2.1 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
I got `The Spark SQL phase optimization failed with an internal error. Please, fill a bug r…
-
-
### Is there an existing issue for this?
- [X] I have searched the existing issues
### Enhancement description
AWS supports Firehose dynamic partitioning of S3 prefixes by using keys in the streami…