-
**Description**
I implemented multi-instance inference across 4 A100 GPUS by following [this](https://triton-inference-server.github.io/pytriton/latest/binding_models/#multi-instance-model-inferenc…
-
In a multi GPU setting, the GPU is always autmatically selected. This causes the voice presets to sometimes be loaded on a separate GPU.
Possible Fix. Include a check to see if the device is set i…
-
### Problem Description
Cannot install. Get error at end:
`FAILED: lib/librockCompiler.a /home/dustin/rocMLIR/build/lib/librockCompiler.a
cd /home/dustin/rocMLIR/build/mlir/tools/rocmlir-lib && …
-
### Discussed in https://github.com/huggingface/diffusers/discussions/9277
Originally posted by **MehmetcanTozlu** August 26, 2024
I have 4 A6000 Ada Generation cards. but I get an error when …
-
### Question Validation
- [X] I have searched both the documentation and discord for an answer.
### Question
I want to use the semantic splitter from llamaindex for document segmentation. Is…
-
Multi GPU train flux, Is the script of flux train not supported now?
-
- [ ] [Release Release 2.0.0 stable · dmlc/xgboost](https://github.com/dmlc/xgboost/releases/tag/v2.0.0)
# Release Release 2.0.0 stable · dmlc/xgboost
## Snippet
We are excited to announce the rele…
-
Hi,
I am curious about how different it is to use multiple MIG instances instead of multiple no-mig GPUs (such as V100) in terms of paralleling, memory sharing etc. I didn't receive same outputs in…
-
### Code of Conduct
- [X] I have read this document and I accept the conditions
### Search previous report
- [X] I have searched my issue
### Computer's operating system
Linux
### Wh…
-
Threw a pretty [easy PR](https://github.com/pixray/pixray/pull/52) up which implements the feature described by post title:
I know it's not perfect as I think maybe other non-pixray libs may still …