search

alibaba / graph-learn

An Industrial Graph Neural Network Framework
Apache License 2.0
1.28k stars 267 forks source link

dgs: decouple service deployment with dataloader #207

Closed goldenleaves closed 2 years ago

goldenleaves commented 2 years ago
  1. delete data loader module from k8s chart.
  2. provide data loading sdk and add related docs.
  3. coordinator no longer manage the state of the data loaders.
  4. delete the worker ready state and related rpc service, introduce barrier mechanism (todo later) instead.