-
Platforms: linux, rocm, slow
This test was disabled because it is failing in CI. See [recent examples](https://hud.pytorch.org/flakytest?name=test_cache_load_model_device_cpu_float64_dynamic_False&…
-
Platforms: linux
This test was disabled because it is failing in CI. See [recent examples](https://hud.pytorch.org/flakytest?name=test_cache_load_model_device_cpu_float32_dynamic_True&suite=TestFxGra…
-
I am using model analyzer 1.42 and server r24.07
1.https://github.com/triton-inference-server/model_analyzer/blob/main/docs/config.md#cli-and-yaml-config-options
# List of composing models that sh…
-
Platforms: linux, rocm, slow
This test was disabled because it is failing in CI. See [recent examples](https://hud.pytorch.org/flakytest?name=test_cache_load_model_device_cpu_float32_dynamic_False&su…
-
### Describe the issue
I am attempting to export a model from HuggingFace from PyTorch to Onnx. After exporting the model, I am trying to confirm the outputs are still correct however it appears that…
-
When 8 processes are launched on a single server using torchrun, and each process executes from_pretrained() for a GPT-J 6B scale model, a CPU memory level OOM occurs.
-
Hi there.
Is there any way running eval_model.py with CPUs?
I am getting the error message:
RuntimeError: Attempting to deserialize object on a CUDA device but torch.cuda.is_available() is Fa…
-
Error occurred when executing T5TextEncode #ELLA:
property 'device' of 'T5EncoderModel' object has no setter
File "C:\Users\jinwen\Desktop\ComfyUI_windows_portable_nvidia_cu121_or_cpu\ComfyUI\ex…
-
Kolors官方代码sample.py可以采用pipe.enable_model_cpu_offload()减少显存占用,
尝试修改DiffSynth的代码来减少Kolors的推理显存
请问DiffSynth是否会考虑支持这个特性
-
```
Error occurred when executing Joy_caption:
Some modules are dispatched on the CPU or the disk. Make sure you have enough GPU RAM to fit the quantized model. If you want to dispatch the model o…