Closed mfbalin closed 2 months ago
To trigger regression tests:
@dgl-bot run [instance-type] [which tests] [compare-with-branch]
;
For example: @dgl-bot run g4dn.4xlarge all dmlc/master
or @dgl-bot run c5.9xlarge kernel,api dmlc/master
Finished working on the PR.
Description
If we store our features in the numpy format using this new function, our io_uring and mmap disk read operations will speedup significantly (2.1 GiB/s vs 1.7 GiB/s) for nice close to power of 2 embedding sizes such as 768
float
s or 512int8
sIt is risk free to do this change because the files that we handle are a lot larger than 4K.
Checklist
Please feel free to remove inapplicable items for your PR.
Changes