jean-zay-users / jean-zay-doc

Collaborative documentation for and from Jean Zay users. Official Jean Zay documentation: http://www.idris.fr/eng/jean-zay/
https://jean-zay-doc.readthedocs.io/en/latest/
MIT License
106 stars 34 forks source link

Creating a conda environment #93

Closed keenjo closed 11 months ago

keenjo commented 1 year ago

Has anyone ever successfully created their own conda environment on jean zay? I find that any time I attempt to do so I run out of memory in my $WORK directory, even when the directory starts empty. Note that I am using the jean zay anaconda module, so there is no issue with my own installation of anaconda or miniconda taking up space. I've also tried using the given PyTorch module as my environment, but it does not work with my scripts.

RemiLacroix-IDRIS commented 1 year ago

Hi. Yes, using personal Conda environment is possible on Jean Zay. Did you follow the steps described on our documentation regarding moving ~/.conda to $WORK/.conda using a symbolic link?

keenjo commented 1 year ago

I believe I have already tried that but I'll give it another go to see if it works!

RemiLacroix-IDRIS commented 1 year ago

The problem had been solved. It was a problem with the symbolic link. Additionally it turns out our PyTorch modules works fine with the keenjo's code.