MemVerge splash issues - Githubissues

MemVerge / splash

Splash, a flexible Spark shuffle manager that supports user-defined storage backends for shuffle data storage and exchange

Apache License 2.0

127 stars 29 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

Bump commons-io:commons-io from 2.4 to 2.14.0

#70 dependabot[bot] opened 1 month ago
0
Bump org.apache.hadoop:hadoop-common from 2.7.4 to 3.4.0

#69 dependabot[bot] opened 2 months ago
0
Bump hadoop-common from 2.7.4 to 3.2.3

#68 dependabot[bot] closed 2 months ago
1
Bump hadoop-common from 2.7.4 to 2.10.1

#67 dependabot[bot] closed 2 years ago
1
java.lang.ClassNotFoundException: org.apache.spark.shuffle.SplashShuffleManager

#66 Roy-Rupak opened 3 years ago
4
Bump commons-io from 2.4 to 2.7

#65 dependabot[bot] closed 1 month ago
2
Add support for HDFS compliant file systems

#64 drnushooz opened 4 years ago
0
[GH-64] Add support for HDFS compliant file systems

#63 drnushooz closed 4 years ago
2
java.lang.IllegalArgumentException because of spark version string being blank

#62 drnushooz closed 4 years ago
1
[GH-60] Support fast merge in storage plugin iface.

#61 jealous closed 5 years ago
1
Support fast merge in the storage plugin interface.

#60 jealous opened 5 years ago
0
java.lang.IllegalAccessError when running with Spark 2.4.0

#59 amorskoy opened 5 years ago
4
[GH-57] Shuffle tool output is not precise

#58 jealous closed 5 years ago
0
The statistics output of the shuffle tool is not precise enough

#57 jealous opened 5 years ago
0
[GH-55] Improve the unsafe code path performance.

#56 jealous closed 5 years ago
1
Improve the performance and memory efficiency in the unsafe code path

#55 jealous closed 5 years ago
0
[GH-53] Batch deploy script.

#54 jealous closed 5 years ago
1
Add deploy script for different Spark & Hadoop versions

#53 jealous closed 5 years ago
0
[GH-51] Cache shuffle index in memory.

#52 jealous closed 5 years ago
1
Cache shuffle index in memory

#51 jealous closed 5 years ago
0
[GH-49] Shuffle performance tool.

#50 jealous closed 5 years ago
2
Create a shuffle tool for performance test

#49 jealous closed 5 years ago
0
[GH-47] Improve merge sort efficiency.

#48 jealous closed 5 years ago
2
Improve the merge sort performance of the external sorter.

#47 jealous closed 5 years ago
0
[GH-45] Stop shuffle manager raises exception

#46 jealous closed 5 years ago
1
Stop the shuffle manager when the app hasn't started raise an exception

#45 jealous closed 5 years ago
0
[GH-43] Structure enhancement of the shuffle reader

#44 jealous closed 5 years ago
1
Structure enhancement of the shuffle reader

#43 jealous closed 5 years ago
0
[GH-41] Create empty shuffle data file failed

#42 jealous closed 5 years ago
1
Create empty shuffle data file failed when the file already exists.

#41 jealous closed 5 years ago
0
[GH-39] Do not use `OutputStream.available()`.

#40 jealous closed 5 years ago
1
Do not rely on `OutputStream.available()`

#39 jealous closed 5 years ago
0
[GH-37] Recuce the number of calls to getSize.

#38 jealous closed 5 years ago
1
Reduce the number of calls to ShuffleFile.getSize

#37 jealous closed 5 years ago
0
[GH-35] Print version during shuffle manager init.

#36 jealous closed 5 years ago
1
Print version info during shuffle manager initialization

#35 jealous closed 5 years ago
0
Remove local storage plugin.

#34 jealous closed 5 years ago
1
Fix compatibility issue for Spark 2.4.0.

#33 jealous closed 5 years ago
2
Change shuffleBlocks from Seq to Iterator in SplashShuffleReader.

#32 weixumv closed 5 years ago
1
Splash doesn't compile with Spark 2.4.0

#31 weixumv closed 5 years ago
3
Put shuffle files in separate folders.

#30 jealous closed 5 years ago
1
Enhance hash based shuffle (bypassMergeSort).

#29 jealous closed 5 years ago
1
Write spill instead of partition data file

#28 jealous closed 5 years ago
2
Remove the file exists check.

#27 jealous closed 5 years ago
1
How to delete the shuffle data

#26 thousandhu closed 5 years ago
5
[GH-24] Dump partition when read error happens

#25 jealous closed 5 years ago
2
Dump shuffle partition when error happens during shuffle read

#24 jealous closed 5 years ago
0
[GH-22] Adjust the location of `onApplicationStart`.

#23 jealous closed 5 years ago
1
SparkConf is not available during `onApplicationStart`

#22 jealous closed 5 years ago
0
[GH-20] Deal with empty file in merge.

#21 jealous closed 5 years ago
1