Open MarcoMeter opened 2 months ago
Hi @vwxyzjn
I have to reopen this issue as I'm facing this again while attempting to execute the benchmarks for pr459 via ./benchmark/ppo_trxl.sh
on my institution's slurm cluster.
Do you have any idea on how to debug this? Is it eligible to omit poetry?
I somehow managed to make it work on my local machine, which was sufficient to generate the pytoml and lock files.
ppo_trxl.sh
# export WANDB_ENTITY=openrlbenchmark
# >>> conda initialize >>>
# !! Contents within this block are managed by 'conda init' !!
__conda_setup="$('/home/mmarplei/anaconda3/bin/conda' 'shell.bash' 'hook' 2> /dev/null)"
if [ $? -eq 0 ]; then
eval "$__conda_setup"
else
if [ -f "/home/mmarplei/anaconda3/etc/profile.d/conda.sh" ]; then
. "/home/mmarplei/anaconda3/etc/profile.d/conda.sh"
else
export PATH="/home/mmarplei/anaconda3/bin:$PATH"
fi
fi
unset __conda_setup
# <<< conda initialize <<<
conda activate py310
poetry install
OMP_NUM_THREADS=1 poetry run python -m cleanrl_utils.benchmark \
--env-ids MortarMayhem-Grid-v0 MysteryPath-Grid-v0 MysteryPath-v0 \
--command "poetry run python ./cleanrl/ppo_trxl/ppo_trxl.py --track --capture_video" \
--num-seeds 3 \
--workers 9 \
--slurm-template-path benchmark/cleanrl_1gpu.slurm_template
OMP_NUM_THREADS=1 poetry run python -m cleanrl_utils.benchmark \
--env-ids MortarMayhem-v0 SearingSpotlights-v0 \
--command "poetry run python ./cleanrl/ppo_trxl/ppo_trxl.py --track --capture_video --reconstruction_coef 0.1" \
--num-seeds 3 \
--workers 9 \
--slurm-template-path benchmark/cleanrl_1gpu.slurm_template
Problem Description
After installing the dependencies via poetry inside a conda environment, any use of poetry results in
ModuleNotFoundError: No module named 'tomli'
.Checklist
poetry install
(see CleanRL's installation guideline.Current Behavior
After creating a fresh conda environment, I run
pip install poetry
followed bypoetry install
. So far no errors are logged and it seems that the installation succeeded. But once poetry is used, likepoetry shell
orpoetry install -E docs
, the package tomli cannot be found even though its listed as completed during the first run ofpoetry install
.Expected Behavior
Open poetry shell or run any documented CleanRL process.
Possible Solution
cd cleanrl
conda create -n cl python=3.10 --yes
conda activate cl
pip install poetry
poetry shell
poetry install
poetry run python cleanrl/ppo.py
Steps to Reproduce
cd cleanrl
conda create -n cl python=3.10 --yes
conda activate cl
pip install poetry
poetry install
poetry shell
or any other poetry commandWhat I tried