-
### What is the problem the feature request solves?
Spark provide multiple ways to run arrow-backed UDFs. The current 3.5 supports `mapInArrow`, in the future 4.0 there will be also `applyInArrow`.…
-
### Feature Request / Improvement
Currently, if the insert statement specifies less columns than the target table size, the following exception will be thrown:
```Exception in thread "main" org.…
-
Hi,
Not sure when issue got introduced exactly, but recently we started seeing loot of SUBMISSION_FAILED errors
After investigation we found out that problem occurs only when we have too many envS…
-
Love the ability to center the first and last columns! Now I'm having a minor issue when using "only scroll as necessary". If I center the first/last column and there is another window that is fully…
-
With AQE enabled on Databricks 14.3, the following tests in AQE are failing:
1. `aqe_test.py::test_aqe_join_with_dpp`
2. `aqe_test.py::test_aqe_join_with_dpp_multi_columns`
This is mentioned as part …
-
### Description
The issue use to add support to read/select file metadata cloumns for parquet scan if spark user explicitly reference them with (for example) `select _metadata.file_path` statement.…
-
## What went wrong?
Both `IdentityToZeroTransformation` and `NullToZeroTransformation` are designed to handle special instances where `LinearTransformer` is used to map `Numeric` columns, but the val…
-
Observed something in the UI and upon looking at the endpoint response think this highlights something more.
##### Steps to reproduce:
* Ran a script that created a `DatasetEvent` ([from OpenLinea…
-
### Is this a new bug in dbt-spark?
- [X] I believe this is a new bug in dbt-spark
- [X] I have searched the existing issues, and I could not find an existing issue for this bug
### Current Behavior…
-
**Describe the problem you faced**
When Spark reads `COW` table with `hiveStylePartitioning` with `glob.paths` (`path` contains '*' or `hoodie.datasource.read.paths` is set) WITH partition values …