dmlc / dgl

Python package built to ease deep learning on graph, on top of existing DL frameworks.
http://dgl.ai
Apache License 2.0
13.51k stars 3.02k forks source link

[GraphBolt][CUDA] Investigate UVA thread count default value. #7038

Open mfbalin opened 9 months ago

mfbalin commented 9 months ago

🔨Work Item

IMPORTANT:

Project tracker: https://github.com/orgs/dmlc/projects/2

Description

https://github.com/dmlc/dgl/blob/fe78093fb74719e39e4bba372d44822a4be8c568/python/dgl/graphbolt/dataloader.py#L172

Investigate whether this default is good for different scenarios and systems. If it is not, we should set the default to a higher value to be safe.

@TristonC

mfbalin commented 2 months ago

Changed the default value to 10240. I wonder if this value is sufficient for the most recent GPUs. Ideally, the value should be specific to a GPU platform depending on the latency and bandwidth characteristics. @TristonC