-
## Feature request
#### Which Delta project/connector is this regarding?
- [x] Spark
- [ ] Standalone
- [ ] Flink
- [ ] Kernel
- [ ] Other (fill in here)
### Overview
Delta allows spec…
-
**Describe the bug**
I am using a spark/pandas dataframe. The dataframe has multiple columns and I am using one of them as a parameter for this expectation. If I use a column which has no null values…
-
### System information
- **Have I written custom code (as opposed to using a stock example script provided in MLflow)**: Yes
- **OS Platform and Distribution (e.g., Linux Ubuntu 16.04)**: Databricks…
-
I understand this might be by design, but https://docs.delta.io/latest/delta-batch.html#add-columns could be made more clear. It currently says,
> By default, nullability is true.
![image](https…
-
```py
from sqlframe.standalone import functions as SF
employee = get_df("employee")
store = get_df("store")
district = get_df("district")
result = (
employee
.alias('employee'…
-
Ignore computing writetimes (& TTLs) when there are no writetime capable columns in the given table schema.
Currently we hit this error which stems from [this condition](https://github.com/datast…
-
**Describe the problem you faced**
1. **Configuration Conflict in Flink Hudi Job**: When modifying the configuration of an existing Flink Hudi Job, if there is a conflict with the Table Config (hoo…
-
## Protocol Change Request
### Description of the protocol change
Spark is introducing support for collated Strings (see [SPARK-46830](https://issues.apache.org/jira/browse/SPARK-46830)) and we …
olaky updated
1 month ago
-
### Pandas version checks
- [X] I have checked that this issue has not already been reported.
- [X] I have confirmed this bug exists on the [latest version](https://pandas.pydata.org/docs/whatsn…
-
### Query engine
- Spark 3.5
- Iceberg 1.5.2
- Azure storage account ABFSS
### Question
I’m trying to use the `MERGE INTO` statement within a Spark streaming application that runs several s…