-
File "torch/_dynamo/variables/constant.py", line 176, in call_method
return ConstantVariable.create(op(self.value, add_target))
torch._dynamo.exc.InternalTorchDynamoError: 'bool' object is n…
-
### System Info
- `transformers` version: 4.44.0
- Platform: Linux-6.5.0-44-generic-x86_64-with-glibc2.35
- Python version: 3.10.12
- Huggingface_hub version: 0.24.5
- Safetensors version: 0.4.…
-
01:54:47-255686 INFO Starting Text generation web UI
01:54:47-260684 WARNING trust_remote_code is enabled. This is dangerous.
01:54:47-268684 INFO Loading the extension "openai"
01:54:47-4…
-
# Bug Report
## Installation Method
Through `docker compose`:
```yaml
open-webui:
container_name: open-webui
image: ghcr.io/open-webui/open-webui:latest
environment:
…
-
## Expected Behavior
No errors displayed after running the cell called "Install Python Packages for Finetuning".
## Actual Behavior
Multiple dependency errors after first run of the cell:
This is a …
-
### 🚀 The feature, motivation and pitch
Now vLLM gemma2 does not support ROPE scaling, and I sincerely hope that support for it will be added in the future.
-
### Your current environment
vllm version: 0.6.3.post1
gpu type: Quadro RTX 4000
### Model Input Dumps
_No response_
### 🐛 Describe the bug
I try to use gamme series such as `google/gemma-2-27…