-
I wouldn't say this is crucial, but it seems if block sizes reach `512 kB` or `1 MB` you might want to move them from Task statedata to being in Mnesia (or maybe just an ETS table because only a singl…
-
For http1.1, header expansion is one of the main reasons for its criticism , so Hpack compression was introduced;
We have also recently encountered some problems where large headers caused the applic…
-
Currently the ISet is not spread over multiple partitions, hence it is impractical for large datasets.
It would be better if the ISet would be backed by an IMap (or ICache) so it will automatically…
-
I changed the base image from gcr.io spark:3.1.1 to spark:3.5.0 and built my dockerfile from there where it has my DataAnalyticsReporting.jar
This is the error when the spark-operator tries to star…
-
### Backend
VL (Velox)
### Bug description
```
Current config settings:
spark.gluten.memory.offHeap.size.in.bytes=15.0 GiB
spark.gluten.memory.task.offHeap.size.in.bytes=3.8 GiB
spark.gluten…
-
### Backend
VL (Velox)
### Bug description
[Expected behavior] - IT should honor s3a filesystem and be able to access files.
[actual behavior] - It fails with the below error :
```
Reason: No…
-
```
semaphore.acquire();
dataSorterAndWriterExecutorService.submit(new DataSorterAndWriter(rowPage));
```
-
With Off-Heap Technology for Large Arrays in GC ([top-level off-heap issue](https://github.com/eclipse-openj9/openj9/issues/14005)), we need to add the test pipeline support for off-heap enabled/disab…
-
When creating and inverted index in a large MV column (3000 integer values on average) from a parquet file with many rows (2 million rows) I get a `SIGSEV` error:
```
#
# A fatal error has been d…
-
### Backend
VL (Velox)
### Bug description
Velox evaluates `date_format(timestamp'12345-01-01 01:01:01', 'yyyy-MM')` to `'12345-07'`, whereas vanilla Spark evaluates the same expression to `'…