-
**Describe the bug**
Getting the following error when I try to load falcon-40b model.
The same config works for opt-30b
```
2023-06-24T00:46:33,240 [INFO ] W-29500-opt_1.0-stdout MODEL_LOG - F…
-
### What happened?
Tripping on this line: https://github.com/ggerganov/llama.cpp/blob/a07c32ea54850c989f0ef6989da5b955b77b7172/src/llama.cpp#L18773C1-L18774C1
~~Meaning, the allocated slot space…
-
The current file example uses TorchRun. It would be great if it use an approach more like Falcon, etc. using transformers and AutoTokenizers - when I try, I get a plethera of errors. :-(
Somethin…
-
When I load the model as following, throw the error: Cannot merge LORA layers when the model is loaded in 8-bit mode
How can I load model with 4bit when inferencing?
`
model_path = 'decapoda-resea…
-
I’m having an issue fine tuning Meta-Llama-3.1-8B-Instruct. Starting with that model downloaded from Hugging Face, I created some dummy training data just to ensure that I can successfully fine tune t…
-
Answering questions on the [support site](https://forums.ankiweb.net) takes up a fair amount of time these days, as it's a busier place than it used to be. Any help you can provide answering people's …
-
My application runs a foreground service which creates a notification for the service.
If the user clicks the notification they get "Stopped working" dialog, but the app does launch.
Build spec:…
-
**Describe the bug**
nvpmodel.service fails to start and any other services needing OpenGL/EGL also do not start
**To Reproduce**
Build QTWebengine for MACHINE=jetson-agx-orin-devkit
**Addit…
kraj updated
3 months ago
-
Describe the bug
I am trying to finetune tiiuae/falcon-7b-instruct and I am getting this error.
`TypeError: where(): argument 'condition' (position 1) must be Tensor, not bool`
**To Reproduce**…
-
**LocalAI version:**
```
commit 8034ed3473fb1c8c6f5e3864933c442b377be52e (HEAD -> master, origin/master, origin/HEAD)
Author: Jesús Espino
Date: Sun Oct 15 09:17:41 2023 +0200
```
**Environ…