search

uber / RemoteShuffleService

Remote shuffle service for Apache Spark to store shuffle data on remote servers.
Other
323 stars 101 forks source link

RSS-K8: Adding environment variable to get the RSS server in K8 environment #45

Closed mabansal closed 3 years ago

mabansal commented 3 years ago

We need to discover the RSS server, in this diff we are adding an environment variable to discover that.

mayurdb commented 3 years ago

@mabansal Can we add a small section in the README of the base branch around the working of RSS servers in K8s -> server ids convention, around plans for the service registry, how would clients discover the RSS servers, etc

mabansal commented 3 years ago

@mabansal Can we add a small section in the README of the base branch around the working of RSS servers in K8s -> server ids convention, around plans for the service registry, how would clients discover the RSS servers, etc

I will add that part of README in K8 branch to avoid confusion

mabansal commented 3 years ago

@mabansal Can we add a small section in the README of the base branch around the working of RSS servers in K8s -> server ids convention, around plans for the service registry, how would clients discover the RSS servers, etc

I will add that part of README in K8 branch to avoid confusion

Done

mabansal commented 3 years ago

Mergin in