-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
…
-
### Proposal to improve performance
_No response_
### Report of performance regression
_No response_
### Misc discussion on performance
使用qwen32b模型，输入tokens 3000，输出tokens 50左右，在单张A800并发量在11，最大响应时…
-
### Your current environment
2024-04-24 06:04:07 (27.2 MB/s) - ‘collect_env.py’ saved [24877/24877]
Collecting environment information...
PyTorch version: 2.2.1+cu121
Is debug build: False
CUDA…
-
## Describe the bug
When using the `PyramidDiTForVideoGeneration` pipeline, a `ValueError` occurs due to the covariance matrix not being positive definite when sampling from a multivariate normal dis…
-
### Your current environment
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: CentOS Linux 7 (Core) (x86_64)
GCC version:…
-
### Your current environment
```text
The output of `python collect_env.py`
The output of `python collect_env.py`
Collecting environment information...
PyTorch version: 2.3.0+cu121
Is debug build…
-
### Your current environment
The output of `python collect_env.py`
```text
Collecting environment information...
PyTorch version: N/A
Is debug build: N/A
CUDA used to build PyTorch: N/A
ROC…
-
### Your current environment
```text
Collecting environment information...
PyTorch version: 2.5.1+cu124
Is debug build: False
CUDA used to build PyTorch: 12.4
ROCM used to build PyTorch: N/A
…
-
### Your current environment
Collecting environment information...
PyTorch version: 2.5.1+cu124 …
-
here is the summary:
`unsloth/mistral-7b-v0.3-bnb-4bit` with error : ` KeyError: 'layers.0.mlp.down_proj.weight'`
`unsloth/Qwen2.5-7B-Instruct-bnb-4bit` with error: `KeyError: 'layers.0.mlp.down_pro…