Explore deploying on the PSMN (CPU-only) cluster

ixxi-dante / an2vec

Bringing node2vec and word2vec together for cool stuff

GNU General Public License v3.0

22 stars 6 forks source link

Explore deploying on the PSMN (CPU-only) cluster #26

Open wehlutyk opened 6 years ago

wehlutyk commented 6 years ago

The PSMN uses Sun Grid Engine, which is now Univa Grid Engine (see wikipedia).

Univa has a recent blog post on how to integrate SGE with Tensorflow, which requires some admin intervention: https://blogs.univa.com/2018/04/integrating-distributed-tensorflow-with-grid-engine/. It's worth talking to the PSMN people about this.

There's also some conversation about this over at TensorFlow: tensorflow/tensorflow#7068

wehlutyk commented 6 years ago

Sam says it is definitely worth talking to PSMN people about this, I'll go with him to see them next time he goes.

wehlutyk commented 6 years ago

So I talked to one of the admins, and it seems totally worth it even though it would be CPU-only (they have a few GPUs, but mostly outdated and very few). Next step: get an account and start reading the docs! http://www.ens-lyon.fr/PSMN/doku.php