-
### Describe the bug
I encountered this problem when running benchmark_e2e_vllm_tp.py,
`loc("/ossfs/workspace/Minference/minference/ops/pit_sparse_flash_atloc(t"e/ntioon_vs2.psy":f110s/:w23)or: err…
-
Are there any plans to produce a bf16 quantization model? whether they can run on a 32GB VRAM
-
(envName) PS C:\Users\XJ768PU\Downloads\llm-graph-builder-main (1)\llm-graph-builder-main\backend> uvicorn score:app --reload
INFO: Will watch for changes in these directories: ['C:\\Users\\XJ768…
-
Are there any available tools that can convert the original .pth model files downloaded from Meta into a format usable by stack, or convert them to .safetensors format? I tried the tool from https://g…
-
Hello !
Forge with flux does'nt work this morning.
but yesterday: yes.
Neveroom seems not working (???)
Thanks !
On My HDD (D:), i have 110go free .....
```
Python 3.10.11 (tags/v3.10…
-
-
This will make it easier to load in Swift (where npz loading is currently supported).
Context from X: https://x.com/awnihannun/status/1824197443216609733
-
ERROR: Could not detect model type of: /root/autodl-tmp/ComfyUI/models/checkpoints/flux-dev-fp8.safetensors ,how to fix it?
also test with flux1-dev.safetensors with same error
-
https://github.com/elixir-nx/safetensors/pull/4
-
it works fine in the webui but failed for the API call