-
During a recent DynamoDB migration, $SPARK_HOME/work on the worker nodes grew to 479 GB, which filled up a 485 GB disk.
To try to work around this, we set:
```
export SPARK_WORKER_OPTS='-Dspark…
-
I am trying to use SparkMeasure on Databricks, but unfortunately, it is not working when the Cluster is on Unity Catalog (Runtime 14.3 LTS).
When running the following code:
```
from sparkmeasu…
-
# Error when using spark_apply method
I am using Spark Connect to perform operations with tables hosted in Unity Catalog (Databricks). When I want to use the `spark_apply` method to process them I…
-
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
YES
**Describe the problem you faced**
A clear and concise description of the prob…
-
**_Tips before filing an issue_**
- Have you gone through our [FAQs](https://hudi.apache.org/learn/faq/)?
- Join the mailing list to engage in conversations and get faster support at dev-subscribe@h…
-
## Bug
#### Which Delta project/connector is this regarding?
- [X] Spark
- [ ] Standalone
- [ ] Flink
- [ ] Kernel
- [ ] Other (fill in here)
### Describe the problem
I am using delta …
-
*Hell All,
We have a issue while doing clustering for one of our job:
Caused by: org.apache.hudi.exception.HoodieException: org.apache.hudi.exception.HoodieException: org.apache.avro.AvroTypeEx…
-
Hi,
I am working on a prototype of a Spark plugin to report the energy consumption of executors. The logic behind is similar to CodeCarbon's, although the computation method differs slightly: the e…
-
**Describe the problem you faced**
Migrated to Hudi 0.14.0 from Hudi version 0.8. While attempting to read Hudi table in parquet format from AWS S3 using Spark receiving the following error:-
…
-
### Skill Name
Airflow, Spark, Presto, Helm, Argo
### Why?
[Apache Airflow](https://airflow.apache.org) is a very popular open source platform to programmatically author, schedule and monitor workf…