search

xgfs / node2vec-c

node2vec implementation in C++
MIT License
50 stars 9 forks source link

Segmentation fault (core dumped) #3

Open Lihengwannafly opened 4 years ago

Lihengwannafly commented 4 years ago

./node2vec -input /data/ECommAI/round1_b/user_item.bcsr -output embedding.bin -dim 64 I use this command, but the following error occurs:

nv: 985597, ne: 69327988
Segmentation fault (core dumped)

32GB memory

xgfs commented 4 years ago

Hi! It may be that there are more second-order degrees than the system can allocate. Can you make a quick check that deepwalk-c (from the other repository) runs on that data?

akastrin commented 4 years ago

Hi, I have the same problem with your node2vec implementation. deepwalk-c works just fine on the same dataset. Any idea what to do?

xgfs commented 4 years ago

Hi! Does it calculate the amount of memory needed for the second-order probability tables? Corresponding line: https://github.com/xgfs/node2vec-c/blob/master/node2vec.cpp#L403

If yes, it may be just the nature of node2vec: for graphs with large star-like patterns it requires cubic memory.