Closed mbbajra closed 3 weeks ago
Hi @mbbajra,
This issue doesn't seem to be related to NeMo Guardrails, but rather to the transformers
library.
I attempted to reproduce the error locally but was unable to do so. The issue could be due to various factors, and one immediate check could be following.
Here are the versions I'm using:
Python version: 3.11.8 (main, Mar 18 2024, 13:25:18) [Clang 15.0.0 (clang-1500.3.9.4)]
setuptools version: 65.5.0
pip version: 24.0
You might want to compare these with your own. If your pip
or setuptools
versions are older, upgrading them might resolve the issue (try it in a virtual env):
pip install --upgrade pip setuptools
If the problem persists, I recommend checking this related issue on the transformers
GitHub page: https://github.com/huggingface/transformers/issues/2831
Ref : examples/configs/llm/hf_pipeline_llama2
I am getting following error while trying to run
pip install accelerate transformers==4.33.1 sentencepiece --upgrade
.....I heard it might have been because of latest version of rustc so I tried RUSTUP_TOOLCHAIN=1.72.1
However, I discovered that it needs latest version of rustc.