Do Storage Scanning thing from GraphD(as proxy or GW) - Githubissues

vesoft-inc / nebula

A distributed, fast open-source graph database featuring horizontal scalability and high availability

https://nebula-graph.io

Apache License 2.0

10.61k stars 1.19k forks source link

Do Storage Scanning thing from GraphD(as proxy or GW) #4509

Open wey-gu opened 2 years ago

wey-gu commented 2 years ago

Background:

It's a blessing that our design(computation and storage are separated), we could enable graph analytical data scanning to bypass the graphD interface.
Yet it's a curse:
- https://discuss.nebula-graph.com.cn/t/topic/9726/25
- Running Nebula Algo/Spark Connector towards a K8s spawned NebulaGraph (https://github.com/vesoft-inc/nebula-cloud-platform/issues/141)

Discussion:

could we consider adding the capability to proxy the connection of Meta/Storage RPC from GraphD(could be the same port or different) to mitigate the pain of connectivity to Meta/StorageD, especially in container/public cloud use cases?

wey-gu commented 2 years ago

cc @Nicole00 @HarrisChu @MuYiYong @veezhang @MegaByte875 @Jerry319609l