search

allenai / reward-bench

RewardBench: the first evaluation tool for reward models.
https://huggingface.co/spaces/allenai/reward-bench
Apache License 2.0
440 stars 52 forks source link

Mistral NEMO 12B Running Error #165

Closed ZhichaoWang970201 closed 3 months ago

ZhichaoWang970201 commented 3 months ago

I think the following error occurs when I run Mistral NEMO 12B. Would you mind fixing that in your github to accommodate this model? Thank you.

rank0: Traceback (most recent call last): rank0: File "/home/ec2-user/anaconda3/bin/rewardbench-gen", line 33, in

rank0: File "/home/ec2-user/SageMaker/Zhichao_experiments/RewardBench/reward-bench/scripts/run_generative.py", line 128, in main rank0: model = LLM(args.model, trust_remote_code=args.trust_remote_code, tensor_parallel_size=args.num_gpus) rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/entrypoints/llm.py", line 144, in init rank0: self.llm_engine = LLMEngine.from_engine_args( rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 359, in from_engine_args rank0: engine = cls( rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/engine/llm_engine.py", line 222, in init rank0: self.model_executor = executor_class( rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/executor/executor_base.py", line 41, in init

rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/executor/gpu_executor.py", line 24, in _init_executor

rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/worker/worker.py", line 121, in load_model

rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/worker/model_runner.py", line 134, in load_model rank0: self.model = get_model( rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/model_executor/model_loader/init.py", line 21, in get_model rank0: return loader.load_model(model_config=model_config, rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/model_executor/model_loader/loader.py", line 243, in load_model

rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/model_executor/models/llama.py", line 408, in load_weights rank0: weight_loader(param, loaded_weight, shard_id) rank0: File "/home/ec2-user/anaconda3/lib/python3.10/site-packages/vllm/model_executor/layers/linear.py", line 625, in weight_loader rank0: loaded_weight = loaded_weight.narrow(output_dim, start_idx, rank0: RuntimeError: start (0) + length (1280) exceeds dimension size (1024).

natolambert commented 3 months ago

Hey @ZhichaoWang970201 -- I think this may be a VLLM issue. You may want to check there, but first, can you share:

ZhichaoWang970201 commented 3 months ago

@natolambert Thank you in advance. vLLM version: vllm==0.4.0 command: rewardbench-gen --model=mistralai/Mistral-Nemo-Instruct-2407

natolambert commented 3 months ago

You should try upgrading VLLM @ZhichaoWang97020, but really this isn't a rewardbench issue as far as I can tell.

I'm going to release a new version later today, I'll bump the VLLM requirement.

ZhichaoWang970201 commented 2 months ago

@natolambert Hey Nato, it still does not work with the same error "RuntimeError: start (0) + length (1280) exceeds dimension size (1024)." even if I have upgrade vllm to 0.5.0. Which version should be used then?

packages in environment at /home/ec2-user/anaconda3:

#

Name Version Build Channel

_libgcc_mutex 0.1 conda_forge conda-forge _openmp_mutex 4.5 2_kmp_llvm conda-forge accelerate 0.33.0 pypi_0 pypi aiohttp 3.9.5 py310h2372a71_0 conda-forge aiosignal 1.3.1 pyhd8ed1ab_0 conda-forge alabaster 0.7.16 pyhd8ed1ab_0 conda-forge alsa-lib 1.2.11 hd590300_1 conda-forge annotated-types 0.7.0 pypi_0 pypi anthropic 0.34.1 pypi_0 pypi anyio 4.4.0 pypi_0 pypi aom 3.9.0 hac33072_0 conda-forge argon2-cffi 23.1.0 pyhd8ed1ab_0 conda-forge argon2-cffi-bindings 21.2.0 py310h2372a71_4 conda-forge arrow 1.3.0 pyhd8ed1ab_0 conda-forge astroid 2.15.8 py310hff52083_0 conda-forge astropy 6.1.0 py310h8a78493_0 conda-forge astropy-iers-data 0.2024.6.3.0.31.14 pyhd8ed1ab_0 conda-forge asttokens 2.4.1 pyhd8ed1ab_0 conda-forge async-lru 2.0.4 pyhd8ed1ab_0 conda-forge async-timeout 4.0.3 pyhd8ed1ab_0 conda-forge atomicwrites 1.4.1 pyhd8ed1ab_0 conda-forge attr 2.5.1 h166bdaf_1 conda-forge attrs 23.2.0 pyh71513ae_0 conda-forge autopep8 2.0.4 pyhd8ed1ab_0 conda-forge autovizwidget 0.21.0 pyh1a96a4e_0 conda-forge aws-c-auth 0.7.22 h96bc93b_2 conda-forge aws-c-cal 0.6.14 h88a6e22_1 conda-forge aws-c-common 0.9.19 h4ab18f5_0 conda-forge aws-c-compression 0.2.18 h83b837d_6 conda-forge aws-c-event-stream 0.4.2 ha47c788_12 conda-forge aws-c-http 0.8.1 h29d6fba_17 conda-forge aws-c-io 0.14.8 h21d4f22_5 conda-forge aws-c-mqtt 0.10.4 h759edc4_4 conda-forge aws-c-s3 0.5.9 h594631b_3 conda-forge aws-c-sdkutils 0.1.16 h83b837d_2 conda-forge aws-checksums 0.1.18 h83b837d_6 conda-forge aws-crt-cpp 0.26.9 he3a8b3b_0 conda-forge aws-sdk-cpp 1.11.329 hba8bd5f_3 conda-forge awscli 1.33.24 pypi_0 pypi babel 2.14.0 pyhd8ed1ab_0 conda-forge backports 1.0 pyhd8ed1ab_3 conda-forge backports.tarfile 1.0.0 pyhd8ed1ab_1 conda-forge beautifulsoup4 4.12.3 pyha770c72_0 conda-forge binaryornot 0.4.4 py_1 conda-forge bitarray 2.9.2 py310h2372a71_0 conda-forge bitsandbytes 0.43.3 pypi_0 pypi black 24.4.2 py310hff52083_0 conda-forge blas 2.120 mkl conda-forge blas-devel 3.9.0 20_linux64_mkl conda-forge bleach 6.1.0 pyhd8ed1ab_0 conda-forge blinker 1.8.2 pyhd8ed1ab_0 conda-forge blosc 1.21.5 hc2324a3_1 conda-forge bokeh 3.4.1 pyhd8ed1ab_0 conda-forge boltons 23.0.0 pyhd8ed1ab_0 conda-forge boto3 1.34.142 pypi_0 pypi botocore 1.34.142 pypi_0 pypi bottleneck 1.3.8 py310h1f7b6fc_0 conda-forge brotli 1.1.0 hd590300_0 conda-forge brotli-bin 1.1.0 hd590300_0 conda-forge brotli-python 1.1.0 py310hc6cd4ac_0 conda-forge brotlipy 0.7.0 py310h2372a71_1006 conda-forge brunsli 0.1 h9c3ff4c_0 conda-forge bzip2 1.0.8 h7f98852_4 conda-forge c-ares 1.28.1 hd590300_0 conda-forge c-blosc2 2.14.4 hb4ffafa_1 conda-forge ca-certificates 2023.7.22 hbcca054_0 conda-forge cached-property 1.5.2 hd8ed1ab_1 conda-forge cached_property 1.5.2 pyha770c72_1 conda-forge cachetools 5.5.0 pypi_0 pypi cairo 1.18.0 h3faef2a_0 conda-forge certifi 2024.6.2 pypi_0 pypi cffi 1.16.0 py310h2fee648_0 conda-forge chardet 5.2.0 py310hff52083_1 conda-forge charls 2.4.2 h59595ed_0 conda-forge charset-normalizer 3.2.0 pyhd8ed1ab_0 conda-forge click 8.1.7 unix_pyh707e725_0 conda-forge cloudpickle 2.2.1 pypi_0 pypi cmake 3.30.2 pypi_0 pypi colorama 0.4.6 pyhd8ed1ab_0 conda-forge comm 0.2.2 pyhd8ed1ab_0 conda-forge conda 23.3.1 py310hff52083_0 conda-forge conda-libmamba-solver 23.3.0 pyhd8ed1ab_0 conda-forge conda-package-handling 2.2.0 pyh38be061_0 conda-forge conda-package-streaming 0.9.0 pyhd8ed1ab_0 conda-forge contourpy 1.2.1 py310hd41b1e2_0 conda-forge cookiecutter 2.6.0 pyhca7485f_0 conda-forge coverage 7.5.3 py310hc51659f_0 conda-forge cryptography 42.0.8 py310hb1bd9d3_0 conda-forge curl 8.8.0 he654da7_0 conda-forge cycler 0.12.1 pyhd8ed1ab_0 conda-forge cython 3.0.10 py310hc6cd4ac_0 conda-forge cytoolz 0.12.3 py310h2372a71_0 conda-forge dask 2024.5.2 pyhd8ed1ab_0 conda-forge dask-core 2024.5.2 pyhd8ed1ab_0 conda-forge dask-expr 1.1.2 pyhd8ed1ab_0 conda-forge datasets 2.21.0 pypi_0 pypi dav1d 1.2.1 hd590300_0 conda-forge dbus 1.13.6 h5008d03_3 conda-forge debugpy 1.8.1 py310hc6cd4ac_0 conda-forge decorator 5.1.1 pyhd8ed1ab_0 conda-forge deepspeed 0.15.0 pypi_0 pypi defusedxml 0.7.1 pyhd8ed1ab_0 conda-forge diff-match-patch 20230430 pyhd8ed1ab_0 conda-forge dill 0.3.8 pyhd8ed1ab_0 conda-forge diskcache 5.6.3 pypi_0 pypi distributed 2024.5.2 pyhd8ed1ab_0 conda-forge distro 1.9.0 pypi_0 pypi docker 7.1.0 pypi_0 pypi docstring-parser 0.16 pypi_0 pypi docstring-to-markdown 0.15 pyhd8ed1ab_0 conda-forge docutils 0.16 pypi_0 pypi dparse 0.6.3 pypi_0 pypi einops 0.8.0 pypi_0 pypi entrypoints 0.4 pyhd8ed1ab_0 conda-forge environment-kernels 1.2.0 pypi_0 pypi et_xmlfile 1.1.0 pyhd8ed1ab_0 conda-forge eval-type-backport 0.2.0 pypi_0 pypi exceptiongroup 1.2.0 pyhd8ed1ab_2 conda-forge executing 2.0.1 pyhd8ed1ab_0 conda-forge expat 2.6.2 h59595ed_0 conda-forge fastapi 0.112.2 pypi_0 pypi fastcache 1.1.0 py310h2372a71_6 conda-forge filelock 3.14.0 pyhd8ed1ab_0 conda-forge flake8 6.0.0 pyhd8ed1ab_0 conda-forge flask 3.0.3 pyhd8ed1ab_0 conda-forge flask-cors 4.0.0 pyhd8ed1ab_0 conda-forge fmt 10.2.1 h00ab1b0_0 conda-forge font-ttf-dejavu-sans-mono 2.37 hab24e00_0 conda-forge font-ttf-inconsolata 3.000 h77eed37_0 conda-forge font-ttf-source-code-pro 2.038 h77eed37_0 conda-forge font-ttf-ubuntu 0.83 h77eed37_2 conda-forge fontconfig 2.14.2 h14ed4e7_0 conda-forge fonts-conda-ecosystem 1 0 conda-forge fonts-conda-forge 1 0 conda-forge fonttools 4.53.0 py310hc51659f_0 conda-forge fqdn 1.5.1 pyhd8ed1ab_0 conda-forge freetype 2.12.1 h267a509_2 conda-forge fribidi 1.0.10 h36c2ea0_0 conda-forge frozenlist 1.4.1 py310h2372a71_0 conda-forge fschat 0.2.36 pypi_0 pypi fsspec 2024.6.0 pyhff2d567_0 conda-forge future 1.0.0 pyhd8ed1ab_0 conda-forge gettext 0.22.5 h59595ed_2 conda-forge gettext-tools 0.22.5 h59595ed_2 conda-forge gevent 23.9.0.post1 py310h216423f_1 conda-forge gflags 2.2.2 he1b5a44_1004 conda-forge giflib 5.2.2 hd590300_0 conda-forge gitdb 4.0.11 pypi_0 pypi gitpython 3.1.43 pypi_0 pypi glib 2.80.2 hf974151_0 conda-forge glib-tools 2.80.2 hb6ce0ca_0 conda-forge glog 0.7.0 hed5481d_0 conda-forge gmp 6.3.0 h59595ed_1 conda-forge gmpy2 2.1.5 py310hc7909c9_1 conda-forge google 3.0.0 pypi_0 pypi google-ai-generativelanguage 0.6.6 pypi_0 pypi google-api-core 2.19.2 pypi_0 pypi google-api-python-client 2.142.0 pypi_0 pypi google-auth 2.34.0 pypi_0 pypi google-auth-httplib2 0.2.0 pypi_0 pypi google-generativeai 0.7.2 pypi_0 pypi google-pasta 0.2.0 pypi_0 pypi googleapis-common-protos 1.65.0 pypi_0 pypi graphite2 1.3.13 h59595ed_1003 conda-forge greenlet 3.0.3 py310hc6cd4ac_0 conda-forge grpcio 1.66.0 pypi_0 pypi grpcio-status 1.62.3 pypi_0 pypi gst-plugins-base 1.22.9 hfa15dee_1 conda-forge gstreamer 1.22.9 h98fc4e7_1 conda-forge gym 0.26.2 pypi_0 pypi gym-notices 0.0.8 pypi_0 pypi h11 0.14.0 pyhd8ed1ab_0 conda-forge h2 4.1.0 pyhd8ed1ab_0 conda-forge h5py 3.11.0 nompi_py310hf054cd7_101 conda-forge harfbuzz 8.5.0 hfac3d4d_0 conda-forge hdf5 1.14.3 nompi_hdf9ad27_105 conda-forge hdijupyterutils 0.21.0 pyh1a96a4e_0 conda-forge hjson 3.1.0 pypi_0 pypi hpack 4.0.0 pyh9f0ad1d_0 conda-forge httpcore 1.0.5 pyhd8ed1ab_0 conda-forge httplib2 0.22.0 pypi_0 pypi httptools 0.6.1 pypi_0 pypi httpx 0.27.0 pyhd8ed1ab_0 conda-forge huggingface-hub 0.24.6 pypi_0 pypi hyperframe 6.0.1 pyhd8ed1ab_0 conda-forge icu 73.2 h59595ed_0 conda-forge idna 3.7 pyhd8ed1ab_0 conda-forge imagecodecs 2024.6.1 py310h6158a3f_0 conda-forge imageio 2.34.1 pyh4b66e23_0 conda-forge imagesize 1.4.1 pyhd8ed1ab_0 conda-forge immutables 0.20 py310h2372a71_1 conda-forge importlib-metadata 6.11.0 pypi_0 pypi importlib_metadata 7.1.0 hd8ed1ab_0 conda-forge importlib_resources 6.4.0 pyhd8ed1ab_0 conda-forge inflection 0.5.1 pyh9f0ad1d_0 conda-forge iniconfig 2.0.0 pyhd8ed1ab_0 conda-forge intel-cmplr-lib-ur 2024.2.1 pypi_0 pypi intel-openmp 2024.2.1 pypi_0 pypi interegular 0.3.3 pypi_0 pypi intervaltree 3.1.0 pyhd8ed1ab_1 conda-forge ipykernel 6.29.3 pyhd33586a_0 conda-forge ipython 8.25.0 pyh707e725_0 conda-forge ipython_genutils 0.2.0 pyhd8ed1ab_1 conda-forge ipywidgets 8.1.3 pyhd8ed1ab_0 conda-forge isoduration 20.11.0 pyhd8ed1ab_0 conda-forge isort 5.13.2 pyhd8ed1ab_0 conda-forge itsdangerous 2.2.0 pyhd8ed1ab_0 conda-forge jaraco.classes 3.4.0 pyhd8ed1ab_1 conda-forge jaraco.context 5.3.0 pyhd8ed1ab_1 conda-forge jaraco.functools 4.0.0 pyhd8ed1ab_0 conda-forge jedi 0.18.2 pyhd8ed1ab_0 conda-forge jeepney 0.8.0 pyhd8ed1ab_0 conda-forge jellyfish 1.0.4 py310he421c4c_0 conda-forge jinja2 3.1.4 pyhd8ed1ab_0 conda-forge jiter 0.5.0 pypi_0 pypi jmespath 1.0.1 pyhd8ed1ab_0 conda-forge joblib 1.4.2 pyhd8ed1ab_0 conda-forge json5 0.9.25 pyhd8ed1ab_0 conda-forge jsonpatch 1.32 pyhd8ed1ab_0 conda-forge jsonpointer 2.0 py_0 conda-forge jsonschema 4.22.0 pyhd8ed1ab_0 conda-forge jsonschema-specifications 2023.12.1 pyhd8ed1ab_0 conda-forge jsonschema-with-format-nongpl 4.22.0 pyhd8ed1ab_0 conda-forge jupyter 1.0.0 pyhd8ed1ab_10 conda-forge jupyter-lsp 2.2.5 pyhd8ed1ab_0 conda-forge jupyter-server-mathjax 0.2.6 pypi_0 pypi jupyter_client 8.6.2 pyhd8ed1ab_0 conda-forge jupyter_console 6.6.3 pyhd8ed1ab_0 conda-forge jupyter_core 5.7.2 py310hff52083_0 conda-forge jupyter_events 0.10.0 pyhd8ed1ab_0 conda-forge jupyter_server 2.14.1 pyhd8ed1ab_0 conda-forge jupyter_server_terminals 0.5.3 pyhd8ed1ab_0 conda-forge jupyterlab 4.2.1 pyhd8ed1ab_0 conda-forge jupyterlab_pygments 0.3.0 pyhd8ed1ab_1 conda-forge jupyterlab_server 2.27.2 pyhd8ed1ab_0 conda-forge jupyterlab_widgets 3.0.11 pyhd8ed1ab_0 conda-forge jxrlib 1.1 hd590300_3 conda-forge keyring 25.2.1 pyha804496_0 conda-forge keyutils 1.6.1 h166bdaf_0 conda-forge kiwisolver 1.4.5 py310hd41b1e2_1 conda-forge krb5 1.21.2 h659d440_0 conda-forge lame 3.100 h166bdaf_1003 conda-forge lark 1.2.2 pypi_0 pypi latex2mathml 3.77.0 pypi_0 pypi lazy-object-proxy 1.10.0 py310h2372a71_0 conda-forge lazy_loader 0.4 pyhd8ed1ab_0 conda-forge lcms2 2.16 hb7c19ff_0 conda-forge ld_impl_linux-64 2.40 h41732ed_0 conda-forge lerc 4.0.0 h27087fc_0 conda-forge libabseil 20240116.2 cxx17_h59595ed_0 conda-forge libaec 1.1.3 h59595ed_0 conda-forge libarchive 3.7.4 hfca40fe_0 conda-forge libarrow 16.1.0 hcb6531f_6_cpu conda-forge libarrow-acero 16.1.0 hac33072_6_cpu conda-forge libarrow-dataset 16.1.0 hac33072_6_cpu conda-forge libarrow-substrait 16.1.0 h7e0c224_6_cpu conda-forge libasprintf 0.22.5 h661eb56_2 conda-forge libasprintf-devel 0.22.5 h661eb56_2 conda-forge libavif16 1.0.4 hd2f8ffe_4 conda-forge libblas 3.9.0 20_linux64_mkl conda-forge libbrotlicommon 1.1.0 hd590300_0 conda-forge libbrotlidec 1.1.0 hd590300_0 conda-forge libbrotlienc 1.1.0 hd590300_0 conda-forge libcap 2.69 h0f662aa_0 conda-forge libcblas 3.9.0 20_linux64_mkl conda-forge libclang-cpp15 15.0.7 default_h127d8a8_5 conda-forge libclang13 18.1.6 default_h5d6823c_0 conda-forge libcrc32c 1.1.2 h9c3ff4c_0 conda-forge libcups 2.3.3 h4637d8d_4 conda-forge libcurl 8.8.0 hca28451_0 conda-forge libdeflate 1.20 hd590300_0 conda-forge libedit 3.1.20191231 he28a2e2_2 conda-forge libev 4.33 h516909a_1 conda-forge libevent 2.1.12 hf998b51_1 conda-forge libexpat 2.6.2 h59595ed_0 conda-forge libffi 3.4.2 h7f98852_5 conda-forge libflac 1.4.3 h59595ed_0 conda-forge libgcc-ng 13.2.0 h77fa898_7 conda-forge libgcrypt 1.10.3 hd590300_0 conda-forge libgettextpo 0.22.5 h59595ed_2 conda-forge libgettextpo-devel 0.22.5 h59595ed_2 conda-forge libgfortran-ng 13.2.0 h69a702a_7 conda-forge libgfortran5 13.2.0 hca663fb_7 conda-forge libglib 2.80.2 hf974151_0 conda-forge libgomp 13.2.0 h77fa898_7 conda-forge libgoogle-cloud 2.24.0 h2736e30_0 conda-forge libgoogle-cloud-storage 2.24.0 h3d9a0c8_0 conda-forge libgpg-error 1.49 h4f305b6_0 conda-forge libgrpc 1.62.2 h15f2491_0 conda-forge libhwloc 2.10.0 default_h5622ce7_1001 conda-forge libhwy 1.1.0 h00ab1b0_0 conda-forge libiconv 1.17 h166bdaf_0 conda-forge libjpeg-turbo 3.0.0 hd590300_1 conda-forge libjxl 0.10.2 hcae5a98_0 conda-forge liblapack 3.9.0 20_linux64_mkl conda-forge liblapacke 3.9.0 20_linux64_mkl conda-forge liblief 0.14.1 hac33072_1 conda-forge libllvm14 14.0.6 hcd5def8_4 conda-forge libllvm15 15.0.7 hb3ce162_4 conda-forge libllvm18 18.1.6 hb77312f_0 conda-forge libllvm9 9.0.1 default_hc23dcda_7 conda-forge libmamba 1.5.1 had39da4_2 conda-forge libmambapy 1.5.1 py310h39ff949_2 conda-forge libnghttp2 1.58.0 h47da74e_1 conda-forge libnsl 2.0.0 h7f98852_0 conda-forge libogg 1.3.4 h7f98852_1 conda-forge libopus 1.3.1 h7f98852_1 conda-forge libparquet 16.1.0 h6a7eafb_6_cpu conda-forge libpng 1.6.43 h2797004_0 conda-forge libpq 16.3 ha72fbe1_0 conda-forge libprotobuf 4.25.3 h08a7969_0 conda-forge libre2-11 2023.09.01 h5a48ba9_2 conda-forge libsndfile 1.2.2 hc60ed4a_1 conda-forge libsodium 1.0.18 h36c2ea0_1 conda-forge libsolv 0.7.24 hfc55251_3 conda-forge libspatialindex 1.9.3 he02047a_5 conda-forge libsqlite 3.45.3 h2797004_0 conda-forge libssh2 1.11.0 h0841786_0 conda-forge libstdcxx-ng 13.1.0 hfd8a6a1_0 conda-forge libsystemd0 255 h3516f8a_1 conda-forge libthrift 0.19.0 hb90f79a_1 conda-forge libtiff 4.6.0 h1dd3fc0_3 conda-forge libutf8proc 2.8.0 h166bdaf_0 conda-forge libuuid 2.38.1 h0b41bf4_0 conda-forge libuv 1.48.0 hd590300_0 conda-forge libvorbis 1.3.7 h9c3ff4c_0 conda-forge libwebp 1.4.0 h2c329e2_0 conda-forge libwebp-base 1.4.0 hd590300_0 conda-forge libxcb 1.15 h0b41bf4_0 conda-forge libxkbcommon 1.7.0 h662e7e4_0 conda-forge libxml2 2.12.7 hc051c1a_1 conda-forge libxslt 1.1.39 h76b75d6_0 conda-forge libzlib 1.2.13 hd590300_5 conda-forge libzopfli 1.0.3 h9c3ff4c_0 conda-forge llvm-openmp 18.1.6 ha31de31_0 conda-forge llvmlite 0.42.0 py310h1b8f574_1 conda-forge lm-format-enforcer 0.10.1 pypi_0 pypi locket 1.0.0 pyhd8ed1ab_0 conda-forge lxml 5.2.2 pypi_0 pypi lz4 4.3.3 py310h350c4a5_0 conda-forge lz4-c 1.9.4 hcb278e6_0 conda-forge lzo 2.10 h516909a_1000 conda-forge mamba 1.5.1 py310h51d5547_2 conda-forge markdown-it-py 3.0.0 pyhd8ed1ab_0 conda-forge markdown2 2.5.0 pypi_0 pypi markupsafe 2.1.5 py310h2372a71_0 conda-forge matplotlib 3.8.4 py310hff52083_2 conda-forge matplotlib-base 3.8.4 py310hef631a5_2 conda-forge matplotlib-inline 0.1.7 pyhd8ed1ab_0 conda-forge mccabe 0.7.0 pyhd8ed1ab_0 conda-forge mdurl 0.1.2 pyhd8ed1ab_0 conda-forge mistune 3.0.2 pyhd8ed1ab_0 conda-forge mkl 2024.2.1 pypi_0 pypi mkl-devel 2023.2.0 ha770c72_50496 conda-forge mkl-include 2023.2.0 h84fe81f_50496 conda-forge mkl-service 2.4.1 py310hc72dfd8_0 conda-forge mkl_fft 1.3.10 py310h0528b3e_1 conda-forge mock 5.1.0 pyhd8ed1ab_0 conda-forge more-itertools 10.2.0 pyhd8ed1ab_0 conda-forge mpc 1.3.1 hfe3b2da_0 conda-forge mpfr 4.2.1 h9458935_1 conda-forge mpg123 1.32.6 h59595ed_0 conda-forge mpmath 1.3.0 pyhd8ed1ab_0 conda-forge msgpack-python 1.0.8 py310h25c7140_0 conda-forge multidict 6.0.5 py310h2372a71_0 conda-forge multiprocess 0.70.16 pypi_0 pypi munkres 1.1.4 pyh9f0ad1d_0 conda-forge mypy_extensions 1.0.0 pyha770c72_0 conda-forge mysql-common 8.3.0 hf1915f5_4 conda-forge mysql-libs 8.3.0 hca2cd23_4 conda-forge nbclient 0.10.0 pyhd8ed1ab_0 conda-forge nbconvert 7.16.4 hd8ed1ab_0 conda-forge nbconvert-core 7.16.4 pyhd8ed1ab_0 conda-forge nbconvert-pandoc 7.16.4 hd8ed1ab_0 conda-forge nbdime 4.0.1 pypi_0 pypi nbformat 5.10.4 pyhd8ed1ab_0 conda-forge ncurses 6.5 h59595ed_0 conda-forge nest-asyncio 1.6.0 pyhd8ed1ab_0 conda-forge networkx 3.3 pyhd8ed1ab_1 conda-forge nh3 0.2.18 pypi_0 pypi ninja 1.11.1.1 pypi_0 pypi nltk 3.8.1 pyhd8ed1ab_0 conda-forge nose 1.3.7 py_1006 conda-forge notebook 7.2.0 pyhd8ed1ab_0 conda-forge notebook-shim 0.2.4 pyhd8ed1ab_0 conda-forge nspr 4.35 h27087fc_0 conda-forge nss 3.100 hca3bf56_0 conda-forge numba 0.59.1 py310h7dc5dd1_0 conda-forge numexpr 2.10.0 mkl_py310ha687524_0 conda-forge numpy 1.23.5 pypi_0 pypi numpydoc 1.7.0 pyhd8ed1ab_1 conda-forge nvidia-cublas-cu12 12.1.3.1 pypi_0 pypi nvidia-cuda-cupti-cu12 12.1.105 pypi_0 pypi nvidia-cuda-nvrtc-cu12 12.1.105 pypi_0 pypi nvidia-cuda-runtime-cu12 12.1.105 pypi_0 pypi nvidia-cudnn-cu12 8.9.2.26 pypi_0 pypi nvidia-cufft-cu12 11.0.2.54 pypi_0 pypi nvidia-curand-cu12 10.3.2.106 pypi_0 pypi nvidia-cusolver-cu12 11.4.5.107 pypi_0 pypi nvidia-cusparse-cu12 12.1.0.106 pypi_0 pypi nvidia-ml-py 12.555.43 pypi_0 pypi nvidia-nccl-cu12 2.20.5 pypi_0 pypi nvidia-nvjitlink-cu12 12.6.20 pypi_0 pypi nvidia-nvtx-cu12 12.1.105 pypi_0 pypi openai 1.42.0 pypi_0 pypi opencv-python 4.10.0.82 pypi_0 pypi openjpeg 2.5.2 h488ebb8_0 conda-forge openpyxl 3.1.2 py310h2372a71_1 conda-forge openssl 3.3.1 h4ab18f5_0 conda-forge orc 2.0.1 h17fec99_1 conda-forge outlines 0.0.46 pypi_0 pypi overrides 7.7.0 pyhd8ed1ab_0 conda-forge packaging 24.1 pypi_0 pypi pandas 1.5.3 pypi_0 pypi pandoc 3.2 ha770c72_0 conda-forge pandocfilters 1.5.0 pyhd8ed1ab_0 conda-forge pango 1.52.2 ha41ecd1_0 conda-forge parso 0.8.4 pyhd8ed1ab_0 conda-forge partd 1.4.2 pyhd8ed1ab_0 conda-forge path 16.14.0 py310hff52083_0 conda-forge pathlib2 2.3.7.post1 py310hff52083_3 conda-forge pathos 0.3.2 pypi_0 pypi pathspec 0.12.1 pyhd8ed1ab_0 conda-forge patsy 0.5.6 pyhd8ed1ab_0 conda-forge pcre 8.45 h9c3ff4c_0 conda-forge pcre2 10.43 hcad00b1_0 conda-forge peft 0.12.0 pypi_0 pypi pexpect 4.9.0 pyhd8ed1ab_0 conda-forge pickleshare 0.7.5 py_1003 conda-forge pid 3.0.4 pypi_0 pypi pillow 10.3.0 py310hf73ecf8_0 conda-forge pip 23.3.2 pyhd8ed1ab_0 conda-forge pixman 0.43.2 h59595ed_0 conda-forge pkginfo 1.11.0 pyhd8ed1ab_0 conda-forge pkgutil-resolve-name 1.3.10 pyhd8ed1ab_1 conda-forge platformdirs 4.2.2 pyhd8ed1ab_0 conda-forge plotly 5.22.0 pyhd8ed1ab_0 conda-forge pluggy 1.5.0 pyhd8ed1ab_0 conda-forge ply 3.11 pyhd8ed1ab_2 conda-forge pox 0.3.4 pypi_0 pypi ppft 1.7.6.8 pypi_0 pypi prometheus-fastapi-instrumentator 7.0.0 pypi_0 pypi prometheus_client 0.20.0 pyhd8ed1ab_0 conda-forge prompt-toolkit 3.0.46 pyha770c72_0 conda-forge prompt_toolkit 3.0.46 hd8ed1ab_0 conda-forge proto-plus 1.24.0 pypi_0 pypi protobuf 4.25.3 pypi_0 pypi psutil 5.9.8 py310h2372a71_0 conda-forge psycopg2 2.9.9 py310h275853b_0 conda-forge psycopg2-binary 2.9.9 pyhd8ed1ab_0 conda-forge pthread-stubs 0.4 h36c2ea0_1001 conda-forge ptyprocess 0.7.0 pyhd3deb0d_0 conda-forge pulseaudio-client 17.0 hb77b528_0 conda-forge pure_eval 0.2.2 pyhd8ed1ab_0 conda-forge py-cpuinfo 9.0.0 pyhd8ed1ab_0 conda-forge py-lief 0.14.1 py310h76e45a6_1 conda-forge py4j 0.10.9.5 pypi_0 pypi pyairports 2.1.1 pypi_0 pypi pyarrow 16.1.0 py310h17c5347_1 conda-forge pyarrow-core 16.1.0 py310h6f79a3a_1_cpu conda-forge pyarrow-hotfix 0.6 pyhd8ed1ab_0 conda-forge pyasn1 0.6.0 pypi_0 pypi pyasn1-modules 0.4.0 pypi_0 pypi pybind11-abi 4 hd8ed1ab_3 conda-forge pycodestyle 2.10.0 pyhd8ed1ab_0 conda-forge pycosat 0.6.6 py310h2372a71_0 conda-forge pycountry 24.6.1 pypi_0 pypi pycparser 2.22 pyhd8ed1ab_0 conda-forge pycryptodome 3.20.0 py310hb0f0acc_0 conda-forge pycurl 7.45.3 py310h80730c7_1 conda-forge pydantic 2.8.2 pypi_0 pypi pydantic-core 2.20.1 pypi_0 pypi pydocstyle 6.3.0 pyhd8ed1ab_0 conda-forge pyerfa 2.0.1.4 py310h261611a_1 conda-forge pyflakes 3.0.1 pyhd8ed1ab_0 conda-forge pyfunctional 1.5.0 pypi_0 pypi pygments 2.18.0 pyhd8ed1ab_0 conda-forge pykerberos 1.2.4 py310h98feede_5 conda-forge pykrb5 0.5.1 py310h98feede_1 conda-forge pylint 2.17.7 pyhd8ed1ab_0 conda-forge pylint-venv 3.0.3 pyhd8ed1ab_0 conda-forge pyls-spyder 0.4.0 pyhd8ed1ab_0 conda-forge pynvml 11.5.0 pyhd8ed1ab_0 conda-forge pyodbc 5.1.0 py310hc6cd4ac_0 conda-forge pyopenssl 24.0.0 pyhd8ed1ab_0 conda-forge pyparsing 3.1.2 pyhd8ed1ab_0 conda-forge pyqt 5.15.9 py310h04931ad_5 conda-forge pyqt5-sip 12.12.2 py310hc6cd4ac_5 conda-forge pyqtwebengine 5.15.9 py310h704022c_5 conda-forge pyrsistent 0.20.0 py310h2372a71_0 conda-forge pysocks 1.7.1 pyha2e5f31_6 conda-forge pyspark 3.3.0 pypi_0 pypi pyspnego 0.10.2 py310hff52083_0 conda-forge pytables 3.9.2 py310hd76cd5d_2 conda-forge pytest 8.2.2 pyhd8ed1ab_0 conda-forge python 3.10.12 hd12c33a_0_cpython conda-forge python-dateutil 2.9.0 pyhd8ed1ab_0 conda-forge python-dotenv 1.0.1 pypi_0 pypi python-fastjsonschema 2.19.1 pyhd8ed1ab_0 conda-forge python-gssapi 1.8.3 py310h98feede_0 conda-forge python-json-logger 2.0.7 pyhd8ed1ab_0 conda-forge python-lsp-black 2.0.0 pyhd8ed1ab_0 conda-forge python-lsp-jsonrpc 1.1.2 pyhd8ed1ab_0 conda-forge python-lsp-server 1.7.4 pyhd8ed1ab_0 conda-forge python-lsp-server-base 1.7.4 pyhd8ed1ab_0 conda-forge python-slugify 8.0.4 pyhd8ed1ab_0 conda-forge python-tzdata 2024.1 pyhd8ed1ab_0 conda-forge python_abi 3.10 3_cp310 conda-forge pytoolconfig 1.2.5 pyhd8ed1ab_0 conda-forge pytz 2024.1 pyhd8ed1ab_0 conda-forge pywavelets 1.4.1 py310h1f7b6fc_1 conda-forge pyxdg 0.28 pyhd8ed1ab_0 conda-forge pyyaml 6.0.1 py310h2372a71_1 conda-forge pyzmq 26.0.3 py310h6883aea_0 conda-forge qdarkstyle 3.1 pyhd8ed1ab_0 conda-forge qstylizer 0.2.3 pyhd8ed1ab_0 conda-forge qt-main 5.15.8 h112747c_20 conda-forge qt-webengine 5.15.8 h3e791b3_6 conda-forge qtawesome 1.3.1 pyh9208f05_0 conda-forge qtconsole 5.4.4 pyhd8ed1ab_0 conda-forge qtconsole-base 5.4.4 pyha770c72_0 conda-forge qtpy 2.4.1 pyhd8ed1ab_0 conda-forge rav1e 0.6.6 he8a937b_2 conda-forge ray 2.35.0 pypi_0 pypi re2 2023.09.01 h7f4b329_2 conda-forge readline 8.2 h8228510_1 conda-forge referencing 0.35.1 pyhd8ed1ab_0 conda-forge regex 2024.5.15 py310hc51659f_0 conda-forge reproc 14.2.4 h0b41bf4_0 conda-forge reproc-cpp 14.2.4 hcb278e6_0 conda-forge requests 2.32.3 pypi_0 pypi requests-kerberos 0.14.0 pyh707e725_1 conda-forge rewardbench 0.1.3 dev_0 rfc3339-validator 0.1.4 pyhd8ed1ab_0 conda-forge rfc3986-validator 0.1.1 pyh9f0ad1d_0 conda-forge rhash 1.4.4 hd590300_0 conda-forge rich 13.7.1 pyhd8ed1ab_0 conda-forge ripgrep 14.1.0 he8a937b_0 conda-forge rope 1.13.0 pyhd8ed1ab_0 conda-forge rpds-py 0.18.1 py310he421c4c_0 conda-forge rsa 4.7.2 pypi_0 pypi rtree 1.2.0 py310hbdcdc62_0 conda-forge ruamel.yaml 0.17.32 py310h2372a71_0 conda-forge ruamel.yaml.clib 0.2.7 py310h1fa729e_1 conda-forge ruamel_yaml 0.15.80 py310h2372a71_1009 conda-forge s2n 1.4.15 he19d79f_0 conda-forge s3fs 0.4.2 pypi_0 pypi s3transfer 0.10.1 pyhd8ed1ab_0 conda-forge safetensors 0.4.4 pypi_0 pypi sagemaker 2.225.0 pypi_0 pypi sagemaker-nbi-agent 1.0 pypi_0 pypi sagemaker-pyspark 1.4.5 pypi_0 pypi schema 0.7.7 pypi_0 pypi scikit-image 0.23.2 py310h2bcf4ab_0 conda-forge scikit-learn 1.5.0 py310h981052a_1 conda-forge scipy 1.13.1 py310h93e2701_0 conda-forge seaborn 0.13.2 hd8ed1ab_2 conda-forge seaborn-base 0.13.2 pyhd8ed1ab_2 conda-forge secretstorage 3.3.3 py310hff52083_2 conda-forge send2trash 1.8.3 pyh0d859eb_0 conda-forge sentencepiece 0.2.0 pypi_0 pypi setuptools 68.1.2 pyhd8ed1ab_0 conda-forge shap 0.45.1 cpu_py310hdd52748_0 conda-forge shellingham 1.5.4 pypi_0 pypi shortuuid 1.0.13 pypi_0 pypi shtab 1.7.1 pypi_0 pypi sip 6.7.12 py310hc6cd4ac_0 conda-forge six 1.16.0 pyh6c4a22f_0 conda-forge slicer 0.0.8 pyhd8ed1ab_0 conda-forge smclarify 0.5 pypi_0 pypi smdebug-rulesconfig 1.0.1 pypi_0 pypi smmap 5.0.1 pypi_0 pypi snappy 1.2.0 hdb0a2a9_1 conda-forge sniffio 1.3.1 pyhd8ed1ab_0 conda-forge snowballstemmer 2.2.0 pyhd8ed1ab_0 conda-forge sortedcontainers 2.4.0 pyhd8ed1ab_0 conda-forge soupsieve 2.5 pyhd8ed1ab_1 conda-forge sparkmagic 0.21.0 pyhd8ed1ab_0 conda-forge sphinx 7.3.7 pyhd8ed1ab_0 conda-forge sphinxcontrib-applehelp 1.0.8 pyhd8ed1ab_0 conda-forge sphinxcontrib-devhelp 1.0.6 pyhd8ed1ab_0 conda-forge sphinxcontrib-htmlhelp 2.0.5 pyhd8ed1ab_0 conda-forge sphinxcontrib-jsmath 1.0.1 pyhd8ed1ab_0 conda-forge sphinxcontrib-qthelp 1.0.7 pyhd8ed1ab_0 conda-forge sphinxcontrib-serializinghtml 1.1.10 pyhd8ed1ab_0 conda-forge sphinxcontrib-websupport 1.2.7 pyhd8ed1ab_0 conda-forge spyder 5.4.5 py310hff52083_0 conda-forge spyder-kernels 2.4.4 unix_pyh707e725_0 conda-forge sqlalchemy 2.0.30 py310hc51659f_0 conda-forge stack_data 0.6.2 pyhd8ed1ab_0 conda-forge starlette 0.38.2 pypi_0 pypi statsmodels 0.14.2 py310h261611a_0 conda-forge svgwrite 1.4.3 pypi_0 pypi svt-av1 2.1.0 hac33072_0 conda-forge sympy 1.12 pypyh9d50eac_103 conda-forge tabulate 0.9.0 pyhd8ed1ab_1 conda-forge tbb 2021.13.1 pypi_0 pypi tblib 3.0.0 pyhd8ed1ab_0 conda-forge tenacity 8.3.0 pyhd8ed1ab_0 conda-forge terminado 0.18.1 pyh0d859eb_0 conda-forge testpath 0.6.0 pyhd8ed1ab_0 conda-forge text-unidecode 1.3 pyhd8ed1ab_1 conda-forge textdistance 4.6.2 pyhd8ed1ab_0 conda-forge threadpoolctl 3.5.0 pyhc1e730c_0 conda-forge three-merge 0.1.1 pyh9f0ad1d_0 conda-forge tifffile 2024.5.22 pyhd8ed1ab_0 conda-forge tiktoken 0.6.0 pypi_0 pypi tinycss2 1.3.0 pyhd8ed1ab_0 conda-forge tk 8.6.13 noxft_h4845f30_101 conda-forge together 1.2.9 pypi_0 pypi tokenizers 0.19.1 pypi_0 pypi toml 0.10.2 pyhd8ed1ab_0 conda-forge tomli 2.0.1 pyhd8ed1ab_0 conda-forge tomlkit 0.12.5 pyha770c72_0 conda-forge toolz 0.12.1 pyhd8ed1ab_0 conda-forge torch 2.3.0 pypi_0 pypi tornado 6.4 py310h2372a71_0 conda-forge tqdm 4.66.4 pyhd8ed1ab_0 conda-forge traitlets 5.14.3 pyhd8ed1ab_0 conda-forge transformers 4.40.0 pypi_0 pypi triton 2.3.0 pypi_0 pypi trl 0.9.6 pypi_0 pypi typed-ast 1.5.5 py310h2372a71_1 conda-forge typer 0.12.5 pypi_0 pypi types-python-dateutil 2.9.0.20240316 pyhd8ed1ab_0 conda-forge typing-extensions 4.12.1 hd8ed1ab_0 conda-forge typing_extensions 4.12.1 pyha770c72_0 conda-forge typing_utils 0.1.0 pyhd8ed1ab_0 conda-forge tyro 0.8.10 pypi_0 pypi tzdata 2023c h71feb2d_0 conda-forge ujson 5.10.0 py310h76e45a6_0 conda-forge unicodedata2 15.1.0 py310h2372a71_0 conda-forge unixodbc 2.3.12 h661eb56_0 conda-forge uri-template 1.3.0 pyhd8ed1ab_0 conda-forge uritemplate 4.1.1 pypi_0 pypi urllib3 2.2.1 pypi_0 pypi uvicorn 0.30.6 pypi_0 pypi uvloop 0.20.0 pypi_0 pypi vllm 0.5.0.post1 pypi_0 pypi vllm-flash-attn 2.5.9 pypi_0 pypi watchdog 4.0.1 py310hff52083_0 conda-forge watchfiles 0.23.0 pypi_0 pypi wavedrom 2.0.3.post3 pypi_0 pypi wcwidth 0.2.13 pyhd8ed1ab_0 conda-forge webcolors 1.13 pyhd8ed1ab_0 conda-forge webencodings 0.5.1 pyhd8ed1ab_2 conda-forge websocket-client 1.8.0 pyhd8ed1ab_0 conda-forge websockets 13.0 pypi_0 pypi werkzeug 3.0.3 pyhd8ed1ab_0 conda-forge whatthepatch 1.0.5 pyhd8ed1ab_0 conda-forge wheel 0.43.0 pypi_0 pypi widgetsnbextension 4.0.11 pyhd8ed1ab_0 conda-forge wrapt 1.16.0 py310h2372a71_0 conda-forge wurlitzer 3.1.0 pyhd8ed1ab_0 conda-forge xcb-util 0.4.0 hd590300_1 conda-forge xcb-util-image 0.4.0 h8ee46fc_1 conda-forge xcb-util-keysyms 0.4.0 h8ee46fc_1 conda-forge xcb-util-renderutil 0.3.9 hd590300_1 conda-forge xcb-util-wm 0.4.1 h8ee46fc_1 conda-forge xformers 0.0.26.post1 pypi_0 pypi xkeyboard-config 2.41 hd590300_0 conda-forge xlsxwriter 3.1.9 pyhd8ed1ab_0 conda-forge xorg-compositeproto 0.4.2 h7f98852_1001 conda-forge xorg-damageproto 1.2.1 h7f98852_1002 conda-forge xorg-fixesproto 5.0 h7f98852_1002 conda-forge xorg-inputproto 2.3.2 h7f98852_1002 conda-forge xorg-kbproto 1.0.7 h7f98852_1002 conda-forge xorg-libice 1.1.1 hd590300_0 conda-forge xorg-libsm 1.2.4 h7391055_0 conda-forge xorg-libx11 1.8.9 h8ee46fc_0 conda-forge xorg-libxau 1.0.11 hd590300_0 conda-forge xorg-libxcomposite 0.4.6 h0b41bf4_1 conda-forge xorg-libxdamage 1.1.5 h7f98852_1 conda-forge xorg-libxdmcp 1.1.3 h7f98852_0 conda-forge xorg-libxext 1.3.4 h0b41bf4_2 conda-forge xorg-libxfixes 5.0.3 h7f98852_1004 conda-forge xorg-libxi 1.7.10 h7f98852_0 conda-forge xorg-libxrandr 1.5.2 h7f98852_1 conda-forge xorg-libxrender 0.9.11 hd590300_0 conda-forge xorg-libxtst 1.2.3 h7f98852_1002 conda-forge xorg-randrproto 1.5.0 h7f98852_1001 conda-forge xorg-recordproto 1.14.2 h7f98852_1002 conda-forge xorg-renderproto 0.11.1 h7f98852_1002 conda-forge xorg-util-macros 1.19.3 h7f98852_0 conda-forge xorg-xextproto 7.3.0 h0b41bf4_1003 conda-forge xorg-xf86vidmodeproto 2.3.1 h7f98852_1002 conda-forge xorg-xproto 7.0.31 h7f98852_1007 conda-forge xxhash 3.5.0 pypi_0 pypi xyzservices 2024.4.0 pyhd8ed1ab_0 conda-forge xz 5.2.6 h166bdaf_0 conda-forge yaml 0.2.5 h7f98852_2 conda-forge yaml-cpp 0.8.0 h59595ed_0 conda-forge yapf 0.40.1 pyhd8ed1ab_0 conda-forge yarl 1.9.4 py310h2372a71_0 conda-forge zeromq 4.3.5 h75354e8_4 conda-forge zfp 1.0.1 h59595ed_0 conda-forge zict 3.0.0 pyhd8ed1ab_0 conda-forge zipp 3.17.0 pyhd8ed1ab_0 conda-forge zlib 1.2.13 hd590300_5 conda-forge zlib-ng 2.0.7 h0b41bf4_0 conda-forge zope.event 5.0 pyhd8ed1ab_0 conda-forge zope.interface 6.4.post2 py310hc51659f_0 conda-forge zstandard 0.19.0 py310h5764c6d_0 conda-forge zstd 1.5.6 ha6fb4c9_0 conda-forge