search

shanice-l / gdrnpp_bop2022

PyTorch Implementation of GDRNPP, winner (most of the awards) of the BOP Challenge 2022 at ECCV'22
Apache License 2.0
233 stars 50 forks source link

pose_refine environment #36

Open jrahim opened 1 year ago

jrahim commented 1 year ago

Hi! The envornment.yaml file does not seem to be doing the job, I'm getting a lot of errors. Some packages on there don't specify versions, which is causing the issues. I've tried various versions of the packages but could not find the right combination. Can you share a more detailed list of the packages than the yaml file? It would also be great if you can share the anaconda environment using conda-pack

mqtjean commented 1 year ago

Hi jrahim, I had some trouble creating the refine environment. With python 3.8 and cuda 11.7 I installed all packages in environment.yaml by hand using pip or conda. (What is your cuda version ?)

Here are the conda package list with associated version and channel for installation. Hope it helps.

# packages in environment at /home/jmoquet/anaconda3/envs/refine:
#
# Name                    Version                   Build  Channel
_libgcc_mutex             0.1                 conda_forge    conda-forge
_openmp_mutex             4.5                       2_gnu    conda-forge
absl-py                   1.4.0                    pypi_0    pypi
blas                      1.0                         mkl  
brotlipy                  0.7.0           py38h27cfd23_1003  
bzip2                     1.0.8                h7b6447c_0  
c-ares                    1.18.1               h7f98852_0    conda-forge
ca-certificates           2022.9.24            ha878542_0    conda-forge
cachetools                4.2.4                    pypi_0    pypi
cairo                     1.16.0            hcf35c78_1003    conda-forge
certifi                   2022.9.24          pyhd8ed1ab_0    conda-forge
cffi                      1.15.0           py38h7f8727e_0  
charset-normalizer        2.0.4              pyhd3eb1b0_0  
colored-traceback         0.3.0                    pypi_0    pypi
contourpy                 1.0.7                    pypi_0    pypi
cryptography              38.0.4           py38h9ce1e76_0  
cuda                      11.7.1                        0    nvidia
cuda-cccl                 11.7.91                       0    nvidia
cuda-command-line-tools   11.7.1                        0    nvidia
cuda-compiler             11.7.1                        0    nvidia
cuda-cudart               11.7.99                       0    nvidia
cuda-cudart-dev           11.7.99                       0    nvidia
cuda-cuobjdump            11.7.91                       0    nvidia
cuda-cupti                11.7.101                      0    nvidia
cuda-cuxxfilt             11.7.91                       0    nvidia
cuda-demo-suite           12.0.140                      0    nvidia
cuda-documentation        12.0.140                      0    nvidia
cuda-driver-dev           11.7.99                       0    nvidia
cuda-gdb                  12.0.140                      0    nvidia
cuda-libraries            11.7.1                        0    nvidia
cuda-libraries-dev        11.7.1                        0    nvidia
cuda-memcheck             11.8.86                       0    nvidia
cuda-nsight               12.0.140                      0    nvidia
cuda-nsight-compute       12.0.1                        0    nvidia
cuda-nvcc                 11.7.99                       0    nvidia
cuda-nvdisasm             12.0.140                      0    nvidia
cuda-nvml-dev             11.7.91                       0    nvidia
cuda-nvprof               12.0.146                      0    nvidia
cuda-nvprune              11.7.91                       0    nvidia
cuda-nvrtc                11.7.99                       0    nvidia
cuda-nvrtc-dev            11.7.99                       0    nvidia
cuda-nvtx                 11.7.91                       0    nvidia
cuda-nvvp                 12.0.146                      0    nvidia
cuda-runtime              11.7.1                        0    nvidia
cuda-sanitizer-api        12.0.140                      0    nvidia
cuda-toolkit              11.7.1                        0    nvidia
cuda-tools                11.7.1                        0    nvidia
cuda-visual-tools         11.7.1                        0    nvidia
cycler                    0.11.0                   pypi_0    pypi
dbus                      1.13.6               hfdff14a_1    conda-forge
expat                     2.4.8                h27087fc_0    conda-forge
fastcore                  1.5.28                   pypi_0    pypi
ffmpeg                    4.3.2                h37c90e5_3    conda-forge
flit-core                 3.6.0              pyhd3eb1b0_0  
fontconfig                2.14.0               hc2a2eb6_1    conda-forge
fonttools                 4.38.0                   pypi_0    pypi
freetype                  2.12.1               h4a9f257_0  
fvcore                    0.1.5.post20221221          pypi_0    pypi
gds-tools                 1.5.1.14                      0    nvidia
gettext                   0.21.1               h27087fc_0    conda-forge
giflib                    5.2.1                h5eee18b_1  
gin-config                0.5.0                    pypi_0    pypi
glib                      2.66.3               h58526e2_0    conda-forge
gmp                       6.2.1                h295c915_3  
gnutls                    3.6.15               he1e5248_0  
google-auth               1.35.0                   pypi_0    pypi
google-auth-oauthlib      0.4.6                    pypi_0    pypi
graphite2                 1.3.13            h58526e2_1001    conda-forge
grpcio                    1.51.1                   pypi_0    pypi
gst-plugins-base          1.14.5               h0935bb2_2    conda-forge
gstreamer                 1.14.5               h36ae1b5_2    conda-forge
harfbuzz                  2.4.0                h9f30f68_3    conda-forge
hdf5                      1.12.1          nompi_h2386368_104    conda-forge
icu                       64.2                 he1b5a44_1    conda-forge
idna                      3.4              py38h06a4308_0  
imageio                   2.25.0                   pypi_0    pypi
importlib-metadata        6.0.0                    pypi_0    pypi
intel-openmp              2021.4.0          h06a4308_3561  
iopath                    0.1.10                   pypi_0    pypi
jasper                    1.900.1           h07fcdf6_1006    conda-forge
jbig                      2.1               h7f98852_2003    conda-forge
joblib                    1.2.0                    pypi_0    pypi
jpeg                      9e                   h7f8727e_0  
keyutils                  1.6.1                h166bdaf_0    conda-forge
kiwisolver                1.4.4                    pypi_0    pypi
krb5                      1.19.3               h3790be6_0    conda-forge
lame                      3.100                h7b6447c_0  
lcms2                     2.12                 h3be6417_0  
lerc                      3.0                  h295c915_0  
libblas                   3.9.0            12_linux64_mkl    conda-forge
libcblas                  3.9.0            12_linux64_mkl    conda-forge
libclang                  9.0.1           default_hb4e5071_5    conda-forge
libcublas                 11.10.3.66                    0    nvidia
libcublas-dev             11.10.3.66                    0    nvidia
libcufft                  10.7.2.124           h4fbf590_0    nvidia
libcufft-dev              10.7.2.124           h98a8f43_0    nvidia
libcufile                 1.5.1.14                      0    nvidia
libcufile-dev             1.5.1.14                      0    nvidia
libcurand                 10.3.1.124                    0    nvidia
libcurand-dev             10.3.1.124                    0    nvidia
libcurl                   7.86.0               h7bff187_1    conda-forge
libcusolver               11.4.0.1                      0    nvidia
libcusolver-dev           11.4.0.1                      0    nvidia
libcusparse               11.7.4.91                     0    nvidia
libcusparse-dev           11.7.4.91                     0    nvidia
libdeflate                1.8                  h7f8727e_5  
libedit                   3.1.20221030         h5eee18b_0  
libev                     4.33                 h516909a_1    conda-forge
libffi                    3.2.1             hf484d3e_1007  
libgcc-ng                 12.2.0              h65d4601_19    conda-forge
libgfortran-ng            12.2.0              h69a702a_19    conda-forge
libgfortran5              12.2.0              h337968e_19    conda-forge
libglib                   2.66.3               hbe7bbb4_0    conda-forge
libgomp                   12.2.0              h65d4601_19    conda-forge
libiconv                  1.16                 h7f8727e_2  
libidn2                   2.3.2                h7f8727e_0  
liblapack                 3.9.0            12_linux64_mkl    conda-forge
liblapacke                3.9.0            12_linux64_mkl    conda-forge
libllvm9                  9.0.1           default_hc23dcda_7    conda-forge
libnghttp2                1.47.0               h727a467_0    conda-forge
libnpp                    11.7.4.75                     0    nvidia
libnpp-dev                11.7.4.75                     0    nvidia
libnvjpeg                 11.8.0.2                      0    nvidia
libnvjpeg-dev             11.8.0.2                      0    nvidia
libopencv                 4.5.3            py38hafa78d9_3    conda-forge
libpng                    1.6.37               hbc83047_0  
libprotobuf               3.18.1               h780b84a_0    conda-forge
libssh2                   1.10.0               haa6b8db_3    conda-forge
libstdcxx-ng              11.2.0               h1234567_1  
libtasn1                  4.16.0               h27cfd23_0  
libtiff                   4.3.0                h6f004c6_2    conda-forge
libunistring              0.9.10               h27cfd23_0  
libuuid                   2.32.1            h7f98852_1000    conda-forge
libwebp                   1.2.4                h11a3e52_0  
libwebp-base              1.2.4                h5eee18b_0  
libxcb                    1.13              h7f98852_1004    conda-forge
libxkbcommon              0.10.0               he1b5a44_0    conda-forge
libxml2                   2.9.10               hee79883_0    conda-forge
libzlib                   1.2.13               h166bdaf_4    conda-forge
lietorch                  0.2                      pypi_0    pypi
lz4-c                     1.9.4                h6a678d5_0  
markdown                  3.4.1                    pypi_0    pypi
markupsafe                2.1.2                    pypi_0    pypi
matplotlib                3.6.3                    pypi_0    pypi
mkl                       2021.4.0           h06a4308_640  
mkl-service               2.4.0            py38h7f8727e_0  
mkl_fft                   1.3.1            py38hd3c417c_0  
mkl_random                1.2.2            py38h51133e4_0  
ncurses                   6.4                  h6a678d5_0  
nettle                    3.7.3                hbbd107a_1  
ninja                     1.11.1                   pypi_0    pypi
nsight-compute            2022.4.1.6                    0    nvidia
nspr                      4.32                 h9c3ff4c_1    conda-forge
nss                       3.59                 h2c00c37_0    conda-forge
numpy                     1.23.5           py38h14f4228_0  
numpy-base                1.23.5           py38h31eccc5_0  
oauthlib                  3.2.2                    pypi_0    pypi
opencv                    4.5.3            py38h578d9bd_3    conda-forge
openh264                  2.1.1                h4ff587b_0  
openssl                   1.1.1s               h166bdaf_0    conda-forge
packaging                 23.0                     pypi_0    pypi
pandas                    1.3.0                    pypi_0    pypi
pcre                      8.45                 h9c3ff4c_0    conda-forge
pillow                    9.3.0            py38h6a678d5_2  
pip                       22.3.1           py38h06a4308_0  
pixman                    0.38.0            h516909a_1003    conda-forge
plyfile                   0.7.4                    pypi_0    pypi
portalocker               2.7.0                    pypi_0    pypi
protobuf                  3.20.3                   pypi_0    pypi
pthread-stubs             0.4               h36c2ea0_1001    conda-forge
py-opencv                 4.5.3            py38he5a9106_3    conda-forge
pyasn1                    0.4.8                    pypi_0    pypi
pyasn1-modules            0.2.8                    pypi_0    pypi
pycocotools               2.0.6                    pypi_0    pypi
pycparser                 2.21               pyhd3eb1b0_0  
pygments                  2.14.0                   pypi_0    pypi
pyopenssl                 22.0.0             pyhd3eb1b0_0  
pyparsing                 3.0.9                    pypi_0    pypi
pypng                     0.20220715.0             pypi_0    pypi
pysocks                   1.7.1            py38h06a4308_0  
python                    3.8.0                h0371630_2  
python-dateutil           2.8.2                    pypi_0    pypi
python_abi                3.8                      2_cp38    conda-forge
pytorch                   1.13.1          py3.8_cuda11.7_cudnn8.5.0_0    pytorch
pytorch-cuda              11.7                 h67b0de4_1    pytorch
pytorch-mutex             1.0                        cuda    pytorch
pytorch3d                 0.7.2                    pypi_0    pypi
pytz                      2022.7.1                 pypi_0    pypi
pyyaml                    6.0                      pypi_0    pypi
qt                        5.12.5               hd8c4c69_1    conda-forge
readline                  7.0                  h7b6447c_5  
requests                  2.28.1           py38h06a4308_0  
requests-oauthlib         1.3.1                    pypi_0    pypi
rsa                       4.9                      pypi_0    pypi
scipy                     1.10.0                   pypi_0    pypi
setuptools                65.6.3           py38h06a4308_0  
six                       1.16.0             pyhd3eb1b0_1  
sqlite                    3.33.0               h62c20be_0  
tabulate                  0.9.0                    pypi_0    pypi
tensorboard               2.6.0                    pypi_0    pypi
tensorboard-data-server   0.6.1                    pypi_0    pypi
tensorboard-plugin-wit    1.8.1                    pypi_0    pypi
termcolor                 2.2.0                    pypi_0    pypi
tk                        8.6.12               h1ccaba5_0  
torch-scatter             2.1.0                    pypi_0    pypi
torchaudio                0.13.1               py38_cu117    pytorch
torchvision               0.14.1               py38_cu117    pytorch
tqdm                      4.64.1                   pypi_0    pypi
transform3d               0.0.4                    pypi_0    pypi
transforms3d              0.4.1                    pypi_0    pypi
typing_extensions         4.4.0            py38h06a4308_0  
urllib3                   1.26.14          py38h06a4308_0  
werkzeug                  2.2.2                    pypi_0    pypi
wheel                     0.37.1             pyhd3eb1b0_0  
x264                      1!161.3030           h7f98852_1    conda-forge
xorg-kbproto              1.0.7             h7f98852_1002    conda-forge
xorg-libice               1.0.10               h7f98852_0    conda-forge
xorg-libsm                1.2.3             hd9c2040_1000    conda-forge
xorg-libx11               1.7.2                h7f98852_0    conda-forge
xorg-libxau               1.0.9                h7f98852_0    conda-forge
xorg-libxdmcp             1.1.3                h7f98852_0    conda-forge
xorg-libxext              1.3.4                h7f98852_1    conda-forge
xorg-libxrender           0.9.10            h7f98852_1003    conda-forge
xorg-renderproto          0.11.1            h7f98852_1002    conda-forge
xorg-xextproto            7.3.0             h7f98852_1002    conda-forge
xorg-xproto               7.0.31            h7f98852_1007    conda-forge
xz                        5.2.10               h5eee18b_1  
yacs                      0.1.8                    pypi_0    pypi
zipp                      3.12.1                   pypi_0    pypi
zlib                      1.2.13               h166bdaf_4    conda-forge
zstd                      1.5.2                ha4553b6_0
jrahim commented 1 year ago

@mqtjean Thank you for your response. I was able to configure an environment by hand as well. I am now trying to train, and get this error: FileNotFoundError: [Errno 2] No such file or directory: 'model_weights/detector/detector-bop-itodd-pbr--509908/config.yaml' In call to configurable 'load_detector' (<function load_detector at 0x7fef1e5d6670>)

Did you get this? The pretrained models available on onedrive dont have the detector files

Basilel7 commented 1 year ago

@jrahim it's a pretrained-model file that is downloadable, should be somewhere on this repo but otherwise, you can download them from the Coupled-Iterative-Refinement repo : https://github.com/princeton-vl/coupled-iterative-refinement . It points to this address to download the weights config : https://drive.google.com/drive/folders/125zNrPFRstkq8pTIaztJc6JmBU7kSNhp