issues
search
bytedance
/
CloudShuffleService
Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
Apache License 2.0
239
stars
57
forks
source link
Does it support dynamic resource allocation?
#3
Open
CHENXCHEN
opened
1 year ago
CHENXCHEN
commented
1 year ago
Does it support both remote shuffle service and dynamic resource allocation?
Does the enabling of
spark.shuffle.service.enabled
have an impact on the shuffle service?
bdyx123
commented
1 year ago
Yes, it supports both
it's ok to turn on spark.shuffle.service.enabled
spark.shuffle.service.enabled
have an impact on the shuffle service?