questions about multiprocess in walker.py

thunlp / OpenNE

An Open-Source Package for Network Embedding (NE)

MIT License

1.68k stars 485 forks source link

questions about multiprocess in walker.py #54

Closed KenGeng closed 4 years ago

KenGeng commented 6 years ago

In your walker.py, I find that you comment out multiprocessing part. I'd like to run random walk process for many times. So, I am wondering whether it is ok for me to just cancel the comment and run the code on a server. Looking forward to your reply~

sun-xiaoyu commented 5 years ago

Same issue. It seems the parameter "workers" is not working. Do you have a fix on that ?

Bznkxs commented 4 years ago

The multiprocessing part is cancelled because there would be too many processes ( =num_walks * node_size) which would take up most of the resources just switching between processes. We are currently looking for a better way to implement multi-processing.