-
### Your current environment
```text
```
### How would you like to use vllm
I have three 4090 GPUs with a total of 24*3 GB of memory, and the model I need to deploy requires at least 52 GB. Th…
-
How can we take advantage of https://huggingface.co/docs/transformers/transformers_agents ?
-
The `yarn build` command fails during building the production build.
This is with nodejs version `20.12.1`.
The .env file is a copy of the example env with only `NEXTAUTH_SECRET=` and `CALENDSO_EN…
-
### System Info
- `transformers` version: 4.46.0.dev0
- Platform: Linux-5.15.0-122-generic-x86_64-with-glibc2.35
- Python version: 3.10.14
- Huggingface_hub version: 0.24.7
- Safetensors version:…
-
### Python -VV
```shell
File "/usr/local/lib/python3.10/dist-packages/vllm/transformers_utils/tokenizer.py", line 13, in
from vllm.transformers_utils.tokenizers import (BaichuanTokenizer,
Fi…
-
**Description of the issue**
The `optimize_for_target_gateset` crashes when trying to optimize XXPowGate with larger global shift value. The optimizer crashes with division by zero error.
**How …
-
I had meet some erros, at begin I think maybe I download the model wrongly， then I redo download but the errors still exist，my python version == 3.11.7 and sentence-transformers ==2.31.0， my transform…
-
### System Info
### System Info
### Environment Details:
- **`trl` version**: `0.11.1`
- **`transformers` version**: `4.45.1`
- **Python version**: `3.10.11`
- **Operating System**: `Linux 4…
-
This checklist is here to help manage the implementation of Transformers. If a card is marked as being in progress then someone is working on it.
If you're new to implementing cards then you likely…
-
I did everything according to the instructions
```
git clone https://github.com/black-forest-labs/flux
python -m venv .venv
source .venv/Scripts/activate
pip install -e “.[all]”
```
then run …