TUM-DAML / seml

SEML: Slurm Experiment Management Library
Other
165 stars 29 forks source link

clean-db command fails due to the switch from tqdm to rich.progress #132

Closed databaaz closed 6 months ago

databaaz commented 6 months ago

Expected Behavior

On running seml clean-db, one should see a progress bar showing current collection name being cleaned

Actual Behavior

Runtime error with message 'generator' object has no attribute 'set_postfix'

Steps to Reproduce the Problem

  1. Run: seml clean-db

Error message:

lib/python3.11/site-packages/seml/database.py:301 in    │
│ clean_unreferenced_artifacts                                                                     │
│                                                                                                  │
│   298 │   tq = track(collection_names)                                                           │
│   299 │   logging.info('Scanning collections for orphaned artifacts...')                         │
│   300 │   for collection_name in tq:                                                             │
│ ❱ 301 │   │   tq.set_postfix(collection=collection_name)                                         │
│   302 │   │   collection = db[collection_name]                                                   │
│   303 │   │   experiments = list(                                                                │
│   304 │   │   │   collection.find(          
....
AttributeError: 'generator' object has no attribute 'set_postfix'

Specifications

Details - Version: 0.4.2 - Python version: 3.11.7 - Platform: 22.04.3 LTS (Jammy Jellyfish) - Anaconda environment (`conda list`): # Name Version Build Channel _libgcc_mutex 0.1 main _openmp_mutex 5.1 1_gnu aiohttp 3.9.3 py311h5eee18b_0 aiosignal 1.2.0 pyhd3eb1b0_0 antlr4-python3-runtime 4.9.3 pypi_0 pypi appdirs 1.4.4 pypi_0 pypi args 0.1.0 pypi_0 pypi attrs 23.1.0 py311h06a4308_0 black 24.2.0 pypi_0 pypi blas 1.0 mkl brotli-python 1.0.9 py311h6a678d5_7 bzip2 1.0.8 h7b6447c_0 ca-certificates 2023.12.12 h06a4308_0 certifi 2024.2.2 py311h06a4308_0 charset-normalizer 2.0.4 pyhd3eb1b0_0 click 8.1.7 pypi_0 pypi clint 0.5.1 pypi_0 pypi colorama 0.4.6 pypi_0 pypi cuda-cudart 12.1.105 0 nvidia cuda-cupti 12.1.105 0 nvidia cuda-libraries 12.1.0 0 nvidia cuda-nvrtc 12.1.105 0 nvidia cuda-nvtx 12.1.105 0 nvidia cuda-opencl 12.3.101 0 nvidia cuda-runtime 12.1.0 0 nvidia debugpy 1.8.1 pypi_0 pypi dnspython 2.5.0 pypi_0 pypi docker-pycreds 0.4.0 pypi_0 pypi docopt 0.6.2 pypi_0 pypi ffmpeg 4.3 hf484d3e_0 pytorch filelock 3.13.1 py311h06a4308_0 freetype 2.12.1 h4a9f257_0 frozenlist 1.4.0 py311h5eee18b_0 fsspec 2023.10.0 py311h06a4308_0 gitdb 4.0.11 pypi_0 pypi gitpython 3.1.42 pypi_0 pypi gmp 6.2.1 h295c915_3 gmpy2 2.1.2 py311hc9b5ff0_0 gnutls 3.6.15 he1e5248_0 idna 3.4 py311h06a4308_0 intel-openmp 2023.1.0 hdb19cb5_46306 jinja2 3.1.3 py311h06a4308_0 joblib 1.2.0 py311h06a4308_0 jpeg 9e h5eee18b_1 jsonpickle 3.0.2 pypi_0 pypi lame 3.100 h7b6447c_0 lcms2 2.12 h3be6417_0 ld_impl_linux-64 2.38 h1181459_1 lerc 3.0 h295c915_0 libcublas 12.1.0.26 0 nvidia libcufft 11.0.2.4 0 nvidia libcufile 1.8.1.2 0 nvidia libcurand 10.3.4.107 0 nvidia libcusolver 11.4.4.55 0 nvidia libcusparse 12.0.2.55 0 nvidia libdeflate 1.17 h5eee18b_1 libffi 3.4.4 h6a678d5_0 libgcc-ng 11.2.0 h1234567_1 libgfortran-ng 11.2.0 h00389a5_1 libgfortran5 11.2.0 h1234567_1 libgomp 11.2.0 h1234567_1 libiconv 1.16 h7f8727e_2 libidn2 2.3.4 h5eee18b_0 libjpeg-turbo 2.0.0 h9bf148f_0 pytorch libnpp 12.0.2.50 0 nvidia libnvjitlink 12.1.105 0 nvidia libnvjpeg 12.1.1.14 0 nvidia libpng 1.6.39 h5eee18b_0 libstdcxx-ng 11.2.0 h1234567_1 libtasn1 4.19.0 h5eee18b_0 libtiff 4.5.1 h6a678d5_0 libunistring 0.9.10 h27cfd23_0 libuuid 1.41.5 h5eee18b_0 libwebp-base 1.3.2 h5eee18b_0 llvm-openmp 14.0.6 h9e868ea_0 lz4-c 1.9.4 h6a678d5_0 markdown-it-py 3.0.0 pypi_0 pypi markupsafe 2.1.3 py311h5eee18b_0 mdurl 0.1.2 pypi_0 pypi mkl 2023.1.0 h213fc3f_46344 mkl-service 2.4.0 py311h5eee18b_1 mkl_fft 1.3.8 py311h5eee18b_0 mkl_random 1.2.4 py311hdb19cb5_0 mpc 1.1.0 h10f8cd9_1 mpfr 4.0.2 hb69a4c5_1 mpmath 1.3.0 py311h06a4308_0 multidict 6.0.4 py311h5eee18b_0 munch 4.0.0 pypi_0 pypi mypy-extensions 1.0.0 pypi_0 pypi ncurses 6.4 h6a678d5_0 nettle 3.7.3 hbbd107a_1 networkx 3.1 py311h06a4308_0 numpy 1.26.3 py311h08b1b3b_0 numpy-base 1.26.3 py311hf175353_0 omegaconf 2.3.0 pypi_0 pypi openh264 2.1.1 h4ff587b_0 openjpeg 2.4.0 h3ad879b_0 openssl 3.0.13 h7f8727e_0 packaging 23.2 pypi_0 pypi pandas 1.5.3 pypi_0 pypi pathspec 0.12.1 pypi_0 pypi pillow 10.2.0 py311h5eee18b_0 pip 23.3.1 py311h06a4308_0 platformdirs 4.2.0 pypi_0 pypi protobuf 4.25.3 pypi_0 pypi psutil 5.9.0 py311h5eee18b_0 py-cpuinfo 9.0.0 pypi_0 pypi py-tgb 0.9.2 pypi_0 pypi pyg 2.5.0 py311_torch_2.2.0_cu121 pyg pygments 2.17.2 pypi_0 pypi pymongo 4.6.1 pypi_0 pypi pyparsing 3.0.9 py311h06a4308_0 pysocks 1.7.1 py311h06a4308_0 python 3.11.7 h955ad1f_0 python-dateutil 2.8.2 pypi_0 pypi pytorch 2.2.0 py3.11_cuda12.1_cudnn8.9.2_0 pytorch pytorch-cuda 12.1 ha16c6d3_5 pytorch pytorch-mutex 1.0 cuda pytorch pytorch-scatter 2.1.2 py311_torch_2.2.0_cu121 pyg pytz 2024.1 pypi_0 pypi pyyaml 6.0.1 py311h5eee18b_0 readline 8.2 h5eee18b_0 requests 2.31.0 py311h06a4308_1 rich 13.7.0 pypi_0 pypi sacred 0.8.5 pypi_0 pypi scikit-learn 1.2.2 py311h6a678d5_1 scipy 1.11.4 py311h08b1b3b_0 seml 0.4.2 pypi_0 pypi sentry-sdk 1.40.4 pypi_0 pypi setproctitle 1.3.3 pypi_0 pypi setuptools 68.2.2 py311h06a4308_0 six 1.16.0 pypi_0 pypi smmap 5.0.1 pypi_0 pypi sqlite 3.41.2 h5eee18b_0 sympy 1.12 py311h06a4308_0 tbb 2021.8.0 hdb19cb5_0 threadpoolctl 2.2.0 pyh0d69192_0 tk 8.6.12 h1ccaba5_0 torchaudio 2.2.0 py311_cu121 pytorch torchtriton 2.2.0 py311 pytorch torchvision 0.17.0 py311_cu121 pytorch tqdm 4.65.0 py311h92b7b1e_0 typer 0.9.0 pypi_0 pypi typing_extensions 4.9.0 py311h06a4308_1 tzdata 2024.1 pypi_0 pypi urllib3 2.1.0 py311h06a4308_1 wandb 0.16.3 pypi_0 pypi wheel 0.41.2 py311h06a4308_0 wrapt 1.16.0 pypi_0 pypi xz 5.4.5 h5eee18b_0 yaml 0.2.5 h7b6447c_0 yarl 1.9.3 py311h5eee18b_0 zlib 1.2.13 h5eee18b_0 zstd 1.5.5 hc292b87_0
n-gao commented 6 months ago

Thanks for reporting this! It's fixed in fa1a10606c2930e21244bbe982f2604f209e5718