-
### Is there an existing issue for this?
- [X] I have searched the existing issues and checked the recent builds/commits
### What would your feature do ?
Hello,
Can you add support for GGUF?
…
-
This did not happen with older unsloth versions. What is happening here?
-
### Your question
Problems with flux dev ggu fp8 q4, please help.
### Logs
```powershell
# ComfyUI Error Report
## Error Details
- **Node Type:** SamplerCustomAdvanced
- **Exception Type:** Runt…
-
I use a lot sdxl for inpainting and upscaling. I wanted to convert my custom sdxl model to Q8 gguf. There is a very slight drop from fp16. I searched for a guide but could not find one. Can you help …
-
### Your current environment
The output of `python env.py`
```text
python env.py
Collecting environment information...
W:\windows_cuda\aphrodite-engine\aphrodite\common\logger.py:66: SyntaxWarn…
-
### Checklist
- [X] 1. If the issue you raised is not a feature but a question, please raise a discussion at https://github.com/sgl-project/sglang/discussions/new/choose Otherwise, it will be closed.…
-
how to run with gguf?
-
Are the CogVideoX tools compatible with: https://github.com/city96/ComfyUI-GGUF?
I am trying to load the quantized versions of the clips without much success, but it seems they would help with the …
-
**Is your feature request related to a problem? Please describe.**
GGUF is becoming the mainstream method for large model compression and accelerated inference. Transformers currently supports the lo…
-
使用llama.cpp/convert_hf_to_gguf.py模型格式转换失败，7B的这个多模态模型是不允许转换吗，转换指令如下：
python convert_hf_to_gguf.py /data/houshiwei/qwen2_model/Qwen/Qwen2-VL-7B-Instruct --outfile /data/houshiwei/gguf_model
报错信息如下：
…