-
### Is your feature request related to a problem?
Windowing functions are not supported in Pyspark backend right now.
### Describe the solution you'd like
I'd like to have support for windowi…
-
**Is your feature request related to a problem? Please describe.**
Test all the features of SE with 3.5 and above, make respective changes for it to work. Update documentation accordingly
**Descri…
-
**Describe the bug**
I'm using an Spark Data Source and Spark Dataframes as Data Assets. When I try to validate the ExpectColumnPairValuesAToBeGreaterThanB expectation it raises an error. I'm going t…
-
1. in /usr/bin/spark-shell or /usr/bin/spark-submit I can not get load-spark-env.sh
so I find this shell find-spark-home not found correct path
then I change is script.
```script
SCRIPT_PATH=$…
-
**Describe the bug**
I have some pyspark code that loads a csv file and appens the data into a CosmosDB container. Sometime I get an error, I can rerun the code and it can work even if the data or the…
-
## Describe the bug
When running on Databricks in Spark Connect mode (for example Shared Isolation mode, Job Cluster, DBR 15.4) - Spark Connect isn't detected by koheesio, which leads to exceptions i…
-
## Expected behavior
I want to use Apache Sedona in pyspark in an AWS glue environment.
## Actual behavior
The sedona librarie does not work when following the steps described in the doc : https:…
-
To install the delta-spark python package on the spark image, you need to download pyspark.zip. pyspark.zip has more than 370 MB. Can I avoid increasing the size of the spark image?
```
FROM spark…
melin updated
1 month ago
-
### Apache Iceberg version
1.4.3
### Query engine
Spark
### Please describe the bug 🐞
Spark config and code -
```
iceberg_rest = {
"spark.sql.extensions": "org.apache.iceberg.spa…
-
### Am I using the newest version of the library?
- [X] I have made sure that I'm using the latest version of the library.
### Is there an existing issue for this?
- [X] I have searched the existin…