[GraphBolt] Async feature fetch refactor

mfbalin commented 1 month ago

Description

@frozenbugs can you take a look at the overall API and let me know how it looks? I will separate into small PRs later, this is a draft PR.

Checklist

Please feel free to remove inapplicable items for your PR.

[ ] The PR title starts with [$CATEGORY] (such as [NN], [Model], [Doc], [Feature]])
[ ] I've leverage the tools to beautify the python and c++ code.
[ ] The PR is complete and small, read the Google eng practice (CL equals to PR) to understand more about small PR. In DGL, we consider PRs with less than 200 lines of core code change are small (example, test and documentation could be exempted).
[ ] All changes have test coverage
[ ] Code is well-documented
[ ] To the best of my knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change
[ ] Related issue is referred in this PR
[ ] If the PR is for a new model/paper, I've updated the example index here.

Changes

dgl-bot commented 1 month ago

To trigger regression tests:

@dgl-bot run [instance-type] [which tests] [compare-with-branch]; For example: @dgl-bot run g4dn.4xlarge all dmlc/master or @dgl-bot run c5.9xlarge kernel,api dmlc/master

dgl-bot commented 1 month ago

Commit ID: de5c5eac9ef14c2c3982d3c881c6bf622b4f0add

Build ID: 1

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 32558173a5ca553d6948f3490c3027353378a468

Build ID: 2

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 7fcc4b403dfe5cb9d4e5335c326943727f9a501c

Build ID: 3

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 83099bc1ec1bb1c473f8cdcded4200a115011dd8

Build ID: 4

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 79e4e2f20f62887705e63f99f8a6e6c0a0c55800

Build ID: 5

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 5b2bf552d1368ba77c8a029e18fd45935a0573a1

Build ID: 6

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 1d49dc8045ee642577d9588d824dd9192bee4405

Build ID: 7

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 10ba72c895e21d48f254943894ad941d17c72f78

Build ID: 8

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 9f408992b45059442973e8d0ea4b60ebdff7a3d5

Build ID: 9

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 537b815dcfbb490725d3e73d4851847a70fdcc5a

Build ID: 10

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 2dc96d9319e6831a386978def4289fce2997ed3b

Build ID: 11

Status: ❌ CI test failed in Stage [Torch CPU Unit test].

Report path: link

Full logs path: link

mfbalin commented 1 month ago

@dgl-bot

dgl-bot commented 1 month ago

Commit ID: 2dc96d9319e6831a386978def4289fce2997ed3b

Build ID: 12

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

mfbalin commented 1 month ago

@dgl-bot

dgl-bot commented 1 month ago

Commit ID: 2dc96d9319e6831a386978def4289fce2997ed3b

Build ID: 13

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

mfbalin commented 1 month ago

@dgl-bot

dgl-bot commented 1 month ago

Commit ID: 2dc96d9319e6831a386978def4289fce2997ed3b

Build ID: 14

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 7eb3ee49478058da5b60e384c3c2abff94d25bf7

Build ID: 15

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 108c418514803a8177f048fe7c6ac3086ffdb0ef

Build ID: 17

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 573a03129824f0ff50db54754aee79199f496664

Build ID: 16

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 080d69dcc63f06ab1285482b568d270e1000fc2f

Build ID: 18

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 6257951c6ea971f6a82aecd49240d31009db872c

Build ID: 19

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: f06ec02fc97adf638d75dfbd02db5c96742b9f85

Build ID: 20

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 06983c398d8317e93159cc88105b484e78ee84b6

Build ID: 21

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: b623645db9e5a4cf2a2fff3a671c0b1924f0307e

Build ID: 22

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 80bed85f56bc2aa98b5aa5f14d313ae32b3e1789

Build ID: 23

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: d805c24af5dafb95105fb3612ad56bebe87d8e10

Build ID: 24

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 52cbd13a8b1ae3c75fce1d26e8925d5f981d145f

Build ID: 25

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 5625d3ac4c9fcd143ba9730142f508438972060b

Build ID: 26

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: f3f57330fb63ef80efb9ced50aaab5c366de4323

Build ID: 27

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: a62395ef4b4e9248cb7d02138f970a8e126d3338

Build ID: 28

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 9161bf9d9ac6345fe95920522bbc8d7a5cece4ae

Build ID: 29

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 05f9a869d75f1719e887c31fc82254cea337d547

Build ID: 30

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 49283ef2406d586eb16840fff9a2416db0746a2b

Build ID: 31

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: 2c197987308a00751bb227fe578f8fba40f24974

Build ID: 32

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: da4d20ae17f6218d7bf5a0ddd6534b1997a98b0f

Build ID: 33

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

mfbalin commented 1 month ago

@frozenbugs, I have merged the contents of this PR in 10 other PRs. If you review them and let me know suggestions and improvements, I can address the reviews in this PR and we can merge this one too.

dgl-bot commented 1 month ago

Commit ID: 42e51942b87e433a8884c21c3f4cd41ca21f6ae6

Build ID: 34

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

mfbalin commented 1 month ago

@frozenbugs I have address your reviews in this initial PR. Further review comments can be addressed in this PR too.

dgl-bot commented 1 month ago

Commit ID: b21951b25604e4fd02d298d108d81c513ccef945

Build ID: 35

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 1 month ago

Commit ID: d9c73e91cb839400991113f0242ca38817d5c154

Build ID: 36

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dmlc / dgl