[GraphBolt][CUDA] Add stream for host to device copies.

mfbalin commented 2 months ago

Description

These will be used to overlap copies from device to host or host to device in nested caches such as GPUCachedFeature<-CPUCachedFeature<-DiskBasedFeature.

I am working on a feature that needs both #7535 and the functionality here so to be able to work, I need to copy code around from these branches.

Checklist

Please feel free to remove inapplicable items for your PR.

[ ] The PR title starts with [$CATEGORY] (such as [NN], [Model], [Doc], [Feature]])
[ ] I've leverage the tools to beautify the python and c++ code.
[ ] The PR is complete and small, read the Google eng practice (CL equals to PR) to understand more about small PR. In DGL, we consider PRs with less than 200 lines of core code change are small (example, test and documentation could be exempted).
[ ] All changes have test coverage
[ ] Code is well-documented
[ ] To the best of my knowledge, examples are either not affected by this change, or have been fixed to be compatible with this change
[ ] Related issue is referred in this PR
[ ] If the PR is for a new model/paper, I've updated the example index here.

Changes

dgl-bot commented 2 months ago

To trigger regression tests:

@dgl-bot run [instance-type] [which tests] [compare-with-branch]; For example: @dgl-bot run g4dn.4xlarge all dmlc/master or @dgl-bot run c5.9xlarge kernel,api dmlc/master

dgl-bot commented 2 months ago

Commit ID: 6281b9bde0d2bb3231d66f8f5fb4b3a677f6fd96

Build ID: 1

Status: ❌ CI test failed in Stage [Lint Check].

Report path: link

Full logs path: link

dgl-bot commented 2 months ago

Commit ID: d9310cf2514299e461260ff43e2e514cc65eb965

Build ID: 2

Status: ⚪️ CI test cancelled due to overrun.

Report path: link

Full logs path: link

dgl-bot commented 2 months ago

Commit ID: 000cbc8129801d2777af40f967a4bcf2baaa5bf5

Build ID: 3

Status: ✅ CI test succeeded.

Report path: link

Full logs path: link

dmlc / dgl