-
### Your current environment
```text
Collecting environment information...
WARNING 07-23 19:11:42 _custom_ops.py:14] Failed to import from vllm._C with ModuleNotFoundError("No module named 'vllm.…
-
**Describe the bug**
when I try to use multi-gpu dbscan, I got (Segmentation fault: invalid permissions for mapped object at address 0x7f0c8e0007c0)
**Steps/Code to reproduce bug**
**Envi…
-
Hello! I got this error when running examples/example_chat.py and share-cap_batch_infer.py with multiple gpus. Does anyone know how to solve it ?
![image](https://github.com/InternLM/InternLM-XCompo…
-
-
### Describe the issue:
I am encountering what appears to be a GPU memory management issue when using the multi-shank configuration in Kilosort 4.0.16. Specifically, when processing data from a Neuro…
-
I am developing an very advanced multi-GPU batch captioning APP
The below code works when I dont use quantization_config=quantization_config because i am able to set `.to(device)`
but when `quan…
-
I'll work through adding it to quantized llama first, as I know that architecture the most. Link to the paper: https://arxiv.org/abs/2310.01889
-
from https://github.com/nagadomi/nunif/discussions/28#discussioncomment-7247459
>i have 2 gpus.
>Haw can i use all gpu in iw3?
-
CI test **linux://rllib:learning_tests_multi_agent_stateless_cartpole_ppo_multi_gpu** is flaky. Recent failures:
- https://buildkite.com/ray-project/postmerge/builds/6004#019182c8-b45e-4374-9df5-693…
-
I was testing "litgpt serve" for llama-3-70b using 4 A100 80G and I receive OOM error. I tried the same command on llama-2-13b and it seems like specifying the "devices" argument only load multiple re…