search

bytedance / CloudShuffleService

Cloud Shuffle Service(CSS) is a general purpose remote shuffle solution for compute engines, including Spark/Flink/MapReduce.
Apache License 2.0
252 stars 57 forks source link

Does it support dynamic resource allocation? #3

Open CHENXCHEN opened 2 years ago

CHENXCHEN commented 2 years ago
  1. Does it support both remote shuffle service and dynamic resource allocation?
  2. Does the enabling of spark.shuffle.service.enabled have an impact on the shuffle service?
bdyx123 commented 2 years ago
  1. Yes, it supports both
  2. it's ok to turn on spark.shuffle.service.enabled