search

sakakibara-yuuki / rl

A modular, primitive-first, python-first PyTorch library for Reinforcement Learning.
MIT License
0 stars 0 forks source link

What I did #2

Open sakakibara-yuuki opened 10 months ago

sakakibara-yuuki commented 10 months ago

I wote what i did for checking rl

pyenv local 3.9.13
python -m venv .rl
source .rl/bin/activate
sakakibara-yuuki commented 10 months ago 
pip install --upgrade pip
sakakibara-yuuki commented 10 months ago 
pip install tensordict-nightly

It's success.

sakakibara-yuuki commented 10 months ago

add .python-version and venv name ".rl" to .gitignore

sakakibara-yuuki commented 10 months ago

install torchrl in develop mode by running

python setup.py develop

was

-- PyTorch dependency: torch
running develop
running egg_info
creating torchrl.egg-info
writing torchrl.egg-info/PKG-INFO
writing dependency_links to torchrl.egg-info/dependency_links.txt
writing requirements to torchrl.egg-info/requires.txt
writing top-level names to torchrl.egg-info/top_level.txt
writing manifest file 'torchrl.egg-info/SOURCES.txt'
/home/sakakibara/project/rl/.rl/lib/python3.9/site-packages/torch/utils/cpp_extension.py:476: UserWarning: Attempted to use ninja as the BuildExtension backend but we could not find ninja.. Falling back to using the slow distutils backend.
  warnings.warn(msg.format('we could not find ninja.'))
reading manifest file 'torchrl.egg-info/SOURCES.txt'
adding license file 'LICENSE'
writing manifest file 'torchrl.egg-info/SOURCES.txt'
running build_ext
building 'torchrl._torchrl' extension
creating build
creating build/temp.linux-x86_64-3.9
creating build/temp.linux-x86_64-3.9/home
creating build/temp.linux-x86_64-3.9/home/sakakibara
creating build/temp.linux-x86_64-3.9/home/sakakibara/project
creating build/temp.linux-x86_64-3.9/home/sakakibara/project/rl
creating build/temp.linux-x86_64-3.9/home/sakakibara/project/rl/torchrl
creating build/temp.linux-x86_64-3.9/home/sakakibara/project/rl/torchrl/csrc
gcc -Wno-unused-result -Wsign-compare -DNDEBUG -g -fwrapv -O3 -Wall -DOPENSSL_NO_SSL3 -fPIC -I/home/sakakibara/project/rl -I/home/sakakibara/project/rl/.rl/lib/python3.9/site-packages/torch/include -I/home/sakakibara/project/rl/.rl/lib/python3.9/site-packages/torch/include/torch/csrc/api/include -I/home/sakakibara/project/rl/.rl/lib/python3.9/site-packages/torch/include/TH -I/home/sakakibara/project/rl/.rl/lib/python3.9/site-packages/torch/include/THC -I/home/sakakibara/project/rl/.rl/include -I/home/sakakibara/.pyenv/versions/3.9.13/include/python3.9 -c /home/sakakibara/project/rl/torchrl/csrc/pybind.cpp -o build/temp.linux-x86_64-3.9/home/sakakibara/project/rl/torchrl/csrc/pybind.o -O3 -std=c++17 -fdiagnostics-color=always -DTORCH_API_INCLUDE_EXTENSION_H -DPYBIND11_COMPILER_TYPE="_gcc" -DPYBIND11_STDLIB="_libstdcpp" -DPYBIND11_BUILD_ABI="_cxxabi1011" -DTORCH_EXTENSION_NAME=_torchrl -D_GLIBCXX_USE_CXX11_ABI=0
In file included from /home/sakakibara/project/rl/torchrl/csrc/pybind.cpp:13:
/home/sakakibara/project/rl/torchrl/csrc/segment_tree.h:34:1: warning: multi-line comment [-Wcomment]
   34 | //                       /             \
      | ^
/home/sakakibara/project/rl/torchrl/csrc/segment_tree.h:36:1: warning: multi-line comment [-Wcomment]
   36 | //          /         \                    /          \
      | ^
/home/sakakibara/project/rl/torchrl/csrc/segment_tree.h:38:1: warning: multi-line comment [-Wcomment]
   38 | //     /     \        /      \        /     \        /      \
      | ^
creating build/lib.linux-x86_64-3.9
creating build/lib.linux-x86_64-3.9/torchrl
g++ -shared -L/home/sakakibara/.pyenv/versions/3.9.13/lib -Wl,-rpath,/home/sakakibara/.pyenv/versions/3.9.13/lib -L/home/sakakibara/.pyenv/versions/3.9.13/lib -Wl,-rpath,/home/sakakibara/.pyenv/versions/3.9.13/lib build/temp.linux-x86_64-3.9/home/sakakibara/project/rl/torchrl/csrc/pybind.o -L/home/sakakibara/project/rl/.rl/lib/python3.9/site-packages/torch/lib -L/home/sakakibara/.pyenv/versions/3.9.13/lib -lc10 -ltorch -ltorch_cpu -ltorch_python -o build/lib.linux-x86_64-3.9/torchrl/_torchrl.so
copying build/lib.linux-x86_64-3.9/torchrl/_torchrl.so -> torchrl
Creating /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages/torchrl.egg-link (link to .)
Adding torchrl 0.1.1+dc573fd to easy-install.pth file

Installed /home/sakakibara/project/rl
Processing dependencies for torchrl==0.1.1+dc573fd
Searching for tensordict>=0.1.1
Reading https://pypi.org/simple/tensordict/
Downloading https://files.pythonhosted.org/packages/dd/b1/06de15b9c3a38b4f133fbb4e2d6228ad22f075fdbc61d0174f31ebb7e227/tensordict-0.1.2-py3-none-any.whl#sha256=09723530487cc223a15baeebcf5bc15f7be7027849386f4c36c8df8df9a6de5e
Best match: tensordict 0.1.2
Processing tensordict-0.1.2-py3-none-any.whl
Installing tensordict-0.1.2-py3-none-any.whl to /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Adding tensordict 0.1.2 to easy-install.pth file

Installed /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages/tensordict-0.1.2-py3.9.egg
Searching for packaging
Reading https://pypi.org/simple/packaging/
Downloading https://files.pythonhosted.org/packages/ab/c3/57f0601a2d4fe15de7a553c00adbc901425661bf048f2a22dfc500caf121/packaging-23.1-py3-none-any.whl#sha256=994793af429502c4ea2ebf6bf664629d07c1a9fe974af92966e4b8d2df7edc61
Best match: packaging 23.1
Processing packaging-23.1-py3-none-any.whl
Installing packaging-23.1-py3-none-any.whl to /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Adding packaging 23.1 to easy-install.pth file

Installed /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages/packaging-23.1-py3.9.egg
Searching for cloudpickle==2.2.1
Best match: cloudpickle 2.2.1
Adding cloudpickle 2.2.1 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for numpy==1.25.2
Best match: numpy 1.25.2
Adding numpy 1.25.2 to easy-install.pth file
Installing f2py script to /home/sakakibara/project/rl/.rl/bin
Installing f2py3 script to /home/sakakibara/project/rl/.rl/bin
Installing f2py3.9 script to /home/sakakibara/project/rl/.rl/bin

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for torch==2.0.1
Best match: torch 2.0.1
Adding torch 2.0.1 to easy-install.pth file
Installing convert-caffe2-to-onnx script to /home/sakakibara/project/rl/.rl/bin
Installing convert-onnx-to-caffe2 script to /home/sakakibara/project/rl/.rl/bin
Installing torchrun script to /home/sakakibara/project/rl/.rl/bin

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for Jinja2==3.1.2
Best match: Jinja2 3.1.2
Adding Jinja2 3.1.2 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-cuda-nvrtc-cu11==11.7.99
Best match: nvidia-cuda-nvrtc-cu11 11.7.99
Adding nvidia-cuda-nvrtc-cu11 11.7.99 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-cusolver-cu11==11.4.0.1
Best match: nvidia-cusolver-cu11 11.4.0.1
Adding nvidia-cusolver-cu11 11.4.0.1 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for networkx==3.1
Best match: networkx 3.1
Adding networkx 3.1 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-nccl-cu11==2.14.3
Best match: nvidia-nccl-cu11 2.14.3
Adding nvidia-nccl-cu11 2.14.3 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-nvtx-cu11==11.7.91
Best match: nvidia-nvtx-cu11 11.7.91
Adding nvidia-nvtx-cu11 11.7.91 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for filelock==3.12.3
Best match: filelock 3.12.3
Adding filelock 3.12.3 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for triton==2.0.0
Best match: triton 2.0.0
Adding triton 2.0.0 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-cufft-cu11==10.9.0.58
Best match: nvidia-cufft-cu11 10.9.0.58
Adding nvidia-cufft-cu11 10.9.0.58 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-cublas-cu11==11.10.3.66
Best match: nvidia-cublas-cu11 11.10.3.66
Adding nvidia-cublas-cu11 11.10.3.66 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-curand-cu11==10.2.10.91
Best match: nvidia-curand-cu11 10.2.10.91
Adding nvidia-curand-cu11 10.2.10.91 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for sympy==1.12
Best match: sympy 1.12
Adding sympy 1.12 to easy-install.pth file
Installing isympy script to /home/sakakibara/project/rl/.rl/bin

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-cuda-runtime-cu11==11.7.99
Best match: nvidia-cuda-runtime-cu11 11.7.99
Adding nvidia-cuda-runtime-cu11 11.7.99 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-cuda-cupti-cu11==11.7.101
Best match: nvidia-cuda-cupti-cu11 11.7.101
Adding nvidia-cuda-cupti-cu11 11.7.101 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for typing-extensions==4.7.1
Best match: typing-extensions 4.7.1
Adding typing-extensions 4.7.1 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-cusparse-cu11==11.7.4.91
Best match: nvidia-cusparse-cu11 11.7.4.91
Adding nvidia-cusparse-cu11 11.7.4.91 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for nvidia-cudnn-cu11==8.5.0.96
Best match: nvidia-cudnn-cu11 8.5.0.96
Adding nvidia-cudnn-cu11 8.5.0.96 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for MarkupSafe==2.1.3
Best match: MarkupSafe 2.1.3
Adding MarkupSafe 2.1.3 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for setuptools==58.1.0
Best match: setuptools 58.1.0
Adding setuptools 58.1.0 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for wheel==0.41.2
Best match: wheel 0.41.2
Adding wheel 0.41.2 to easy-install.pth file
Installing wheel script to /home/sakakibara/project/rl/.rl/bin

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for lit==16.0.6
Best match: lit 16.0.6
Adding lit 16.0.6 to easy-install.pth file
Installing lit script to /home/sakakibara/project/rl/.rl/bin

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for cmake==3.27.4.1
Best match: cmake 3.27.4.1
Adding cmake 3.27.4.1 to easy-install.pth file
Installing cmake script to /home/sakakibara/project/rl/.rl/bin
Installing cpack script to /home/sakakibara/project/rl/.rl/bin
Installing ctest script to /home/sakakibara/project/rl/.rl/bin

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Searching for mpmath==1.3.0
Best match: mpmath 1.3.0
Adding mpmath 1.3.0 to easy-install.pth file

Using /home/sakakibara/project/rl/.rl/lib/python3.9/site-packages
Finished processing dependencies for torchrl==0.1.1+dc573fd
sakakibara-yuuki commented 10 months ago

Pre-commits

pip install pre-commit
Successfully installed cfgv-3.4.0 distlib-0.3.7 identify-2.5.27 nodeenv-1.8.0 platformdirs-3.10.0 pre-commit-3.4.0 pyyaml-6.0.1 virtualenv-20.24.5
pre-commit run --all-files

It's success