-
I select this model in constants.py as follows:
```
MODEL_ID = "TheBloke/Wizard-Vicuna-7B-Uncensored-GPTQ"
MODEL_BASENAME = "Wizard-Vicuna-7B-Uncensored-GPTQ-4bit-128g.no-act.order.safetensors"
``…
-
hardware information: agx xavier, L4T:35.4.0, Jetpack:5.1.2.
and cloned the branch R35.4.1.
I tried below commands in container dustynv/local_llm:r35.3.1 and had error:
root@agx-xavier:/data/mo…
-
In reviewing the updated ```docs``` I notice a few things that prompted some questions...
1) Neither AWQ/Int-4/```int32_float16``` are mentioned in the "Quantize on model conversion" nor "Quantize…
-
**Is the bug primarily related to salmon (bulk mode) or alevin (single-cell mode)?**
salmon
**Describe the bug**
I'm working with 15 samples, with ~5Gb total reads per sample (90,000,000 to 100,…
-
Tried fine-tuning the [InstructCodeT5+](https://huggingface.co/Salesforce/instructcodet5p-16b) model using QLoRA and the loss is stuck at a particular value. Code for the experiment:
```
import pand…
-
### Your current environment
```text
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.3 LTS (x86_64)
GCC ve…
-
Hello, I am trying to import a table from QuPath but keeping receiving the following error:
``
Error in r[i1] - r[-length(r):-(length(r) - lag + 1L)] :
non-numeric argument to binary operator
`…
-
Hello, I ran Trinity on a series of RNA-seq data sets using the below command. I however get the below error, where 1 "Final Trinity" assembly failed. Does anyone know what the error could be associat…
-
Please comment here any model requests for:
- Models to be added to https://huggingface.co/neuralmagic
- Example scripts within `llm-compressor`
-
Traceback (most recent call last):
File ".../localGPT-main/app.py", line 143, in
main()
File "/root/anaconda3/envs/localGPT/lib/python3.10/site-packages/click/core.py", line 1157, in __cal…