-
There's an older vulnerability from 2021 that gets flagged when we're trying to use the spark-operator:
https://github.com/advisories/GHSA-f5f7-6478-qm6p
I haven't looked into the details of the…
-
**Describe the bug**
I have an entity defined with a schema option (i.e news) that is a keyword list with its key types defined by keys. One of the fields (publication_date) may be a function that w…
-
We are trying to setup RayDP in a Ray Cluster(Remote). We have created a Dockerfile with Java and Ray, and verified if JAVA_HOME is set and Java is installed
**Dockerfile**
```
FROM rayproject/ra…
-
Hi there,
I use Malt as a render engine and I was wondering how would I set it up in the Batch render? I thought the render output was just an override but there's no setting to pick the one in the…
-
Currently Spark Structured streaming writes metadata files inside _spark_metadata directory with following content in json format
{code}
{ path : String, size : Long, isDir : Boolean, modificationTi…
-
### Apache Iceberg version
1.4.2 (latest release)
### Query engine
Spark
### Please describe the bug 🐞
When performing a copy-on-write merge (I haven't verified yet MoR) Spark will completely ign…
-
### Description
We have a problem converting uploads from Spark to Polars.
This conversion is implemented in Pandas, but it takes a very long time to work on huge data. I would like to see this func…
-
Hi，William;
Could you have any plans to upgrade spark 3.1.x, we are using spark 3.1.x to explore spark cdc
thank you，good luck!
-
Thank you for this nice project.
I was wondering if there is going to be any integration with spark data frames or big data with your work.
Really sorry if that integration exists and I couldn't f…
-
### Server Implementation
Paper
### Server Version
1.21.1
### Describe the bug
Plotsquared is installed on a server, currently 8GB of ram, and experiences a lot of freezing / laggspikes (every 20…