This PR adds scripts to prepare environment for pre-training with Megatron-LM on llm-jp-nvlink cluster.
Most of the scripts are almost the same with installer scripts for sakura, but small changes have been done, such as SLURM partitions (gpu-debug -> gpu).
The main differences are in pretrain/installers/v3-megatron-llm-jp-nvlink/scripts/{mpi_variables, environment}.sh .
This PR adds scripts to prepare environment for pre-training with Megatron-LM on llm-jp-nvlink cluster. Most of the scripts are almost the same with installer scripts for sakura, but small changes have been done, such as SLURM partitions (gpu-debug -> gpu). The main differences are in
pretrain/installers/v3-megatron-llm-jp-nvlink/scripts/{mpi_variables, environment}.sh.