search

Alluxio / alluxio

Alluxio, data orchestration for analytics and machine learning in the cloud
https://www.alluxio.io
Apache License 2.0
6.82k stars 2.93k forks source link

Separate Worker/Client executor service on master side #14072

Open LuQQiu opened 3 years ago

LuQQiu commented 3 years ago

Is your feature request related to a problem? Please describe. When users have a large number of clients/workers, since they shared the same executor service, client-master operation may block master-worker communication. We want to have separate executor services for workers and clients.

Describe the solution you'd like A clear and concise description of what you want to happen.

Describe alternatives you've considered A clear and concise description of any alternative solutions or features you've considered.

Urgency Explain why the feature is important

Additional context Reported @maobaolong @ggezer mentioned that it requires changes from the gRPC side

LuQQiu commented 3 years ago

@maobaolong @ggezer Please provide more information about this issue, thanks!

ggezer commented 3 years ago

FYI; separate executors means separate gRPC servers, which means binding to separate ports.

maobaolong commented 3 years ago

@ggezer Yeah, exactly, it just like hdfs which have to port 8020 for client call, 8021 for datanode call

LuQQiu commented 3 years ago

Add a configuration to use separate ports

github-actions[bot] commented 1 year ago

This issue has been automatically marked as stale because it has not had recent activity. It will be closed in two weeks if no further activity occurs. Thank you for your contributions.