issues
search
uber
/
RemoteShuffleService
Remote shuffle service for Apache Spark to store shuffle data on remote servers.
Other
321
stars
100
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Corrupted block detected during decompression
#102
YutingWang98
opened
10 months ago
0
[Spark 3] RSS performance with Adaptive Skew Join Optimization
#101
s0nskar
opened
1 year ago
3
Fix Rss getReader mapIdx bug
#100
YutingWang98
opened
1 year ago
2
Spark 3.1/3.2 failed sql skew and local reader tests
#99
YutingWang98
opened
1 year ago
2
Does Rss support YARN executor preemption?
#98
YutingWang98
closed
1 year ago
0
[WIP] Add tolerance in RSS cluster for server going away
#97
mayurdb
opened
1 year ago
1
Does zeus only support jdk 11 +
#95
every-breaking-wave
opened
1 year ago
2
what may cause RssInvalidServerVersionException?
#94
Lobo2008
opened
1 year ago
2
Can Rss have stage retry when one server is down?
#93
YutingWang98
opened
1 year ago
13
How to evaluate rss cluster size?
#92
Lobo2008
opened
1 year ago
1
Support zstd compression for shuffle data
#91
hiboyang
closed
1 year ago
3
Rss shuffle data size is much larger than external shuffle service
#90
YutingWang98
closed
1 year ago
6
Disk damage causes failure
#89
Lobo2008
opened
1 year ago
10
Root directory not configurable via Helm chart
#88
nadenf
opened
1 year ago
0
Adding k8 support for server side id aware read and write clients
#87
mabansal
closed
1 year ago
0
adding K8 support for retriable read client
#86
mabansal
closed
1 year ago
0
Adding support for K8 in replicate read and write clients
#85
mabansal
closed
1 year ago
0
Adding Registry client for K8
#84
mabansal
closed
1 year ago
0
Adding suuport for pooled write client for K8
#83
mabansal
closed
1 year ago
0
Adding multi server write client for K8
#82
mabansal
closed
1 year ago
1
How long the shuffle data of each ShuffleStage will be stored in RSS nodes?
#81
Lobo2008
opened
1 year ago
6
Adding multi server read and write client for K8
#80
mabansal
closed
1 year ago
0
Adding multi sever async client
#79
mabansal
closed
1 year ago
0
Adding Data block clients for k8
#78
mabansal
closed
2 years ago
0
Initial commit for Sprak 3.2 for K8
#77
mabansal
closed
2 years ago
0
hit exception writing heading bytes XXXXX
#76
Lobo2008
closed
1 year ago
8
close writers during end of stage using onStageCompleted
#75
tuckerh99
opened
2 years ago
4
Optimize memory usage and reduce GC by eliminating memory copies 3x
#74
ambud
opened
2 years ago
1
Add support to run RSS on Kubernetes for Spark 3.2
#73
ghost
closed
2 years ago
1
Metrics in ScheduledMetricCollector
#72
Lobo2008
closed
1 year ago
0
Does RSS support multiple StreamServers on the same node?
#71
Lobo2008
closed
2 years ago
4
fault tolerance of restarting server
#70
cpd85
opened
2 years ago
7
write amplification
#69
cpd85
opened
2 years ago
2
Shuffle Files Storage Is stored by default.Whether alluxio storage is supported and how to implement it.
#68
liangrui1988
opened
2 years ago
5
Using remote shuffle service with Spark operator
#67
roligupt
opened
2 years ago
2
spark 3.0
#66
avs-alatau
opened
2 years ago
4
When to remove shuffle data in /tmp/StreamServer_* ？
#65
Lobo2008
closed
2 years ago
0
Unable to register with external shuffle server
#64
Lobo2008
closed
2 years ago
9
which branch should be used for building jar and image for remote shuffle service for K8 environment?
#63
roligupt
opened
2 years ago
6
spark 3.1/3.2?
#62
cpd85
opened
2 years ago
10
Not support Storing data on HDFS and dynamicAllocation?
#61
Lobo2008
closed
2 years ago
1
Failed to get all RSS servers
#60
Lobo2008
closed
2 years ago
3
[Proposal] Unsafe memory management in RSS mappers
#59
mayurdb
opened
2 years ago
0
Why not use netty to create and manage client
#58
ipositive7
opened
2 years ago
0
Whether to consider publishing the RemoteShuffleService jar to the Maven repository?
#57
wangyi2021
opened
3 years ago
0
Does rss support hiveOnSpark?
#56
jinzhejz
closed
3 years ago
3
how to run on k8s
#55
hwk42
closed
2 years ago
0
shuffle read error
#54
D3077
closed
3 years ago
5
[WIP] Unsafe shuffle writer support in RSS
#53
mayurdb
opened
3 years ago
6
Remove use of String format in favor of SLF4J anchor
#52
belugabehr
opened
3 years ago
1
Next