-
**Is your feature request related to a problem? Please describe.**
Transforming data within a Database (input/output is the same database) with Spark is inefficient, as we need to read the data from …
-
I have a hadoop cluster with spark enabled on it. Can I run spark -perf on this cluster? Or should it be standalone cluster with spark on it?
-
### Query engine
use spark with iceberg
### Question
here is my iceberg table
root
|-- partition_time: long (nullable = true)
|-- base: struct (nullable = true)
| |-- report_time_ms: lon…
-
Thanks for the great tool. I use pyspark on Spark 3.1.1, but when I read SAS file, it gives the following error
: java.lang.BootstrapMethodError: java.lang.NoClassDefFoundError: com/epam/parso/impl…
-
-
Adding a recursive field to a proto breaks things, see https://github.com/drewrobb/sparksql-scalapb-test/commit/4cfc436c5a3a9f75d4218a0695ff7e9c2b8300e3 for a reproduction. I'm happy to help address t…
-
### Apache Iceberg version
None
### Query engine
Spark
### Please describe the bug 🐞
The issue repros using the following SQL:
```sql
CREATE TABLE iceberg.NullabilityPartition(
group STRING …
-
The bug is the same as described in [https://github.com/dataflint/spark/issues/13](This bug report)
When I try to access data flint through a knox gateway, it tries to access without the gateway
…
-
Add a new set of pages/data under retrievals. This should be in line with what Filecoin Pulse Does:
-
### Query engine
Spark
### Question
V2 table support equality deletes for row level delete. When I use the Java API to write a large number of delete records and then start the spark rewrite files…