-
install vLLM with CUDA 11.8 by running:
# Install vLLM with CUDA 11.8.
# Replace `cp310` with your Python version (e.g., `cp38`, `cp39`, `cp311`).
pip install https://github.com/vllm-project/vllm/r…
-
OS: windows
MTL iGPU
intel-extension-for-pytorch 2.0.110+gitba7f6c1
bigdl-core-xe 2.4.0.dev0
bigdl-llm 2.4.0b20231029
```
>python example3.py
Loading checkpoint…
-
Excellent work for training optimization! I have a question for a long time and can an expert like you help me with it?
test code is as below:
```
import torch
import triton.ops
import time
…
-
### System Info
- `transformers` version: 4.35.0.dev0
- Platform: Linux-4.14.0_1-0-0-44-x86_64-with-glibc2.27
- Python version: 3.9.17
- Huggingface_hub version: 0.16.4
- Safetensors version: 0…
-
My validation images are coming out empty:
Which is odd as I'm only doing one epoch on top of juggernaut. One of my suspicions is that I'm using the Juggernaut model but the VAE was defaulted t…
-
## Summary
Add x86 CPU support for low-bit training and inference.
## Motivation
The current bitsandbytes library is bound with CUDA environment. We are seeing that there is a growing deman…
-
### Issue type
Bug
### Have you reproduced the bug with TensorFlow Nightly?
No
### Source
source
### TensorFlow version
2.14.0
### Custom code
Yes
### OS platform and distribution
Ubuntu 22…
-
### Issue type
Bug
### Have you reproduced the bug with TensorFlow Nightly?
No
### Source
source
### TensorFlow version
2.14.0
### Custom code
Yes
### OS platform and distribution
Ubuntu 22…
-
### Issue type
Bug
### Have you reproduced the bug with TensorFlow Nightly?
No
### Source
source
### TensorFlow version
2.14.0
### Custom code
Yes
### OS platform and distribution
Ubuntu 22…
-
### Issue type
Bug
### Have you reproduced the bug with TensorFlow Nightly?
No
### Source
source
### TensorFlow version
2.14.0
### Custom code
Yes
### OS platform and distribution
Ubuntu 22…