-
### 🐛 Describe the bug
ValueError: Target modules {'v_proj', 'up_proj', 'o_proj', 'down_proj', 'k_proj', 'q_proj', 'gate_proj'} not found in the base model. Please check the target modules and try …
-
Fully supported! Scroll down on our latest Mistral notebook: https://colab.research.google.com/drive/1Dyauq4kTZoLewQ1cApceUQVNcnnNTzg_?usp=sharing
For 16bit merging:
```
model.save_pretrained_mer…
-
Using released llmcompressor 0.1.0 on python 3.11 on ubuntu 20.04
Phi3Small Instruct does not have the default weights in the mapping (q_proj, k_proj, v_proj), so I supplied my own and it failed wi…
-
When I used the example data to test the program, I get an error
```bash
Error in file(con, "r") : cannot open the connection
Calls: readLines -> file
In addition: Warning message:
In file(con, "…
-
I trying quantize [lightblue/qarasu-14B-chat-plus-unleashed](https://huggingface.co/lightblue/qarasu-14B-chat-plus-unleashed) based [Qwen/Qwen-14B-Chat](https://huggingface.co/Qwen/Qwen-14B-Chat) .
…
-
Hello Dusty
Here's the thing. We recently keep working on Jetson Orin projects. When I decided to copy my environment to another Orin. I just wonder can we use local model to load such as VILA or L…
-
### Your current environment
The output of `python collect_env.py`
```text
C:\Users\bobni\OneDrive\Desktop\Projects\p2pIssue>bash
training@Training:/mnt/c/Users/bobni/OneDrive/Desktop/Projects…
-
Hello, I ran Trinity on a series of RNA-seq data sets using the below command. I however get the below error, where 1 "Final Trinity" assembly failed. Does anyone know what the error could be associat…
-
Looking forward to the next update that moves away from SNAP, but until then, here are some issues I've been having over the past two weeks and what eventually led to a "successful" run. Because the g…
-
### Checklist
- [ ] 1. I have searched related issues but cannot get the expected help.
- [ ] 2. The bug has not been fixed in the latest version.
### Describe the bug
使用lmdeploy lite auto_a…