-
Can infini run on multi cards? When the requests pressure is high, the bra1 memory is not enough.
 port supports GPU acceleration (Direct3D, OpenGL, Metal). Anyway the GPU acceleration isn't working as expected (it's slower than the so…
dacap updated
7 hours ago
-
As per https://cloud.google.com/free/docs/free-cloud-features
Your Free Trial credits apply to all Google …
-
### Your current environment
The output of `python collect_env.py`
```text
device=V100 * 4
vllm==0.6.4.post1
```
### 🐛 Describe the bug
When I attempt to use the newly added…
-
I am trying to use both of my GPUs who are passed through to my docker container.
```
services: faster-whisper-server-cuda: image: fedirz/faster-whisper-server:latest-cuda build: dockerfile: Dockerf…
-
### Describe the bug
When I run the test case “tests/integrate/102_pw_pint_uks” using the command OMP_NUM_THREADS=1 mpirun -n 1 abacus, I noticed that if I set both `init_wfc nao` and `device gpu`, t…
-
My use case scenario is deploying model inference services in the cloud, utilizing GPU virtualization technology to split one GPU into multiple instances. Each instance runs a model, and since one car…