search

snap-stanford / ogb

Benchmark datasets, data loaders, and evaluators for graph machine learning
https://ogb.stanford.edu
MIT License
1.89k stars 397 forks source link

A problem of loading large graph #386

Closed zhuangbility111 closed 1 year ago

zhuangbility111 commented 1 year ago

Hi! When I load the large graph such as ogbn-papers100M, I find the size of graph is too large to load. So I'm wondering whether ogb provide functions, with which we just load the structure of graph (edge list of graph), but don't load the feature vectors of each nodes on the graph into memory. As we know, the feature size will occupy a large proportion of the size of graph.

weihua916 commented 1 year ago

Hi! Really good point. Unfortunately, we do not provide such functionality for the OGB datasets, but we do for the OGB-LSC datasets.

zhuangbility111 commented 1 year ago

OK, thank you very much