-
Hi guys. I've been stepping songs for a pretty long time now. I've got my own methods and all but there's always "that" issue that has been bugging me for a pretty long time: the editor itself.
Don't…
-
**Describe the bug**
While implementing a recommended recipe to compress the LLM, facing an issue.
**Expected behavior**
Successful compression of the LLM
**To Reproduce**
```
Exact steps …
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
- [X] 3. Please note that if the bug-related iss…
-
环境：SE7-32
```
SophonSDK version: 23.09 LTS
sophon-soc-libsophon : 0.4.9
sophon-soc-libsophon-dev : 0.4.9
sophon-mw-soc-sophon-ffmpeg : 0.8.0
sophon-mw-soc-sophon-opencv : 0.8.0
BL2 v2.7(release…
-
### OS
Linux
### GPU Library
CUDA 12.x
### Python version
3.12
### Pytorch version
torch==2.4.1
### Model
mistralai/Mistral-Large-Instruct-2407, Qwen/Qwen2.5-72B-Instruct
…
-
Hi,
I am on spacemacs, so I am not sure whether this is an ESS issue or a spacemacs issue. In any case, I am trying to use the lsp server for R files but it fails to start (even after restarts. The…
-
### Issue Description
- Downloaded this UNET, put it in the models\unet folder: https://civitai.com/models/843551?modelVersionId=943939
- Loaded Flux-qint4
- Attempted to load the UNET above from…
-
Hi,
GPU : A10 24 GB
Model size with safe tensors : 26 GB all together
With HF pipeline, it was possible to load llama3 8b and then convert it too fp16 and run inference
but with VLLM, when I t…
-
This issue regards to the [warnings that for QLoRA PeFT we should pass `peft_config` directly to `SFTTrainer`](https://github.com/huggingface/trl/blob/99f2c94b2200927a1dc156f16e012dca11f865e1/trl/trai…
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
- [ ] 3. Please note that if the bug-related issue y…