search

dmlc / dgl

Python package built to ease deep learning on graph, on top of existing DL frameworks.
http://dgl.ai
Apache License 2.0
13.37k stars 3k forks source link

How to use dgl with hdfs? #6365

Open youngeryoungeryang opened 12 months ago

youngeryoungeryang commented 12 months ago

hi, the User Guide says the function dgl.load_graphs() supports "loading the graphs directly from hdfs (by providing "hdfs://..." a path)", I try it and get the following results (here 10.242.187.67 is the ip address of namenode in my hdfs) : image The Trackback shows I need to compile with DMLC_USE_HDFS=1 to use hdfs, but when I compile DGL with dgl/script/build_dgl.sh, I don't find anywhere to add this flag. Can someone tell me the correct way to use dgl with hdfs?

github-actions[bot] commented 11 months ago

This issue has been automatically marked as stale due to lack of activity. It will be closed if no further activity occurs. Thank you

Rhett-Ying commented 11 months ago

please try with -e '-DDMLC_USE_HDFS=1'

github-actions[bot] commented 9 months ago

This issue has been automatically marked as stale due to lack of activity. It will be closed if no further activity occurs. Thank you