search

idaholab / moose

Multiphysics Object Oriented Simulation Environment
https://www.mooseframework.org
GNU Lesser General Public License v2.1
1.7k stars 1.04k forks source link

Make compatible Conda moose-dev and PyTorch #28161

Open milljm opened 1 month ago

milljm commented 1 month ago

Motivation

Figure out the pinning requirements to make PyTorch compatible with our Conda packages

Design

Add more pinnings to our conda/mpi recipe.

Impact

Users will be able to install both moose-dev and pytorch

YaqiWang commented 1 month ago

I installed with the latest moose-dev:

pytorch                   2.3.1           cpu_generic_py311h82099cb_1    conda-forge
milljm commented 1 month ago

I think you might be missing the version of moose-dev. We ran into that as well when we thought it was working:

<trimmed>
  moose-dev          public/osx-arm64::moose-dev-2023.05.02-build_0 
                                                 ^^^^ problematic
  moose-libmesh      public/osx-arm64::moose-libmesh-2023.04.19-build_0 
  moose-libmesh-vtk  public/osx-arm64::moose-libmesh-vtk-9.2.6-h6b51079_0 
  moose-mpich        public/osx-arm64::moose-mpich-4.0.2-build_7 
  moose-petsc        public/osx-arm64::moose-petsc-3.16.6-build_6 
  moose-test-tools   public/osx-arm64::moose-test-tools-2023.08.31-py310h39238f2_0 
  moose-tools        public/osx-arm64::moose-tools-2023.05.02-py310h39238f2_0 
  moose-wasp         public/osx-arm64::moose-wasp-2023.04.04-build_0 
<trimmed>
  pytorch            pytorch/osx-arm64::pytorch-2.3.1-py3.10_0

Linux also exhibits an out-right conflict with VTK.

milljm commented 1 month ago

@YaqiWang Oh, you might be using Conda-Forge's PyTorch? @grmnptr has instructed that I get PyTorch from another channel. Basically, this is what I was instructed to get working (on Linux):

conda create -n testing moose-dev mpich pytorch pytorch==2.1 \
  pytorch-cuda=12.1 -c pytorch -c nvidia

The following seems to work currently on the Mac:

conda create -n testing moose-dev mpich pytorch pytorch==2.1 \
  -c pytorch -c nvidia

@YaqiWang, Is the above Apple Si install what you are attempting?

YaqiWang commented 1 month ago

No, I simply did conda install pytorch in moose env. I have

# packages in environment at /Users/wangy2/mambaforge3/envs/moose:
moose-dev                 2024.07.15              openmpi    https://conda.software.inl.gov/public
moose-libmesh             2024.05.05            openmpi_1    https://conda.software.inl.gov/public
moose-libmesh-vtk         9.3.0                 openmpi_0    https://conda.software.inl.gov/public
moose-mpi                 2024.07.10              openmpi    https://conda.software.inl.gov/public
moose-peacock             2024.07.10            openmpi_0    https://conda.software.inl.gov/public
moose-petsc               3.20.3                openmpi_1    https://conda.software.inl.gov/public
moose-tools               2024.07.10      py311h2ac6507_0    https://conda.software.inl.gov/public
moose-wasp                2024.05.08              build_0    https://conda.software.inl.gov/public

and the pytorch-2.3.1 as I mentioned above.