-
I am loading a model on gpu, but i get a warning that is it also loaded on cpu. is it normal i can't use it for inference?
model is loaded, but i get error: `lmql.models.lmtp.errors.LMTPStreamError…
-
Type: Bug
❗️❗️❗️ Please fill in the sections below to help us diagnose the issue ❗️❗️❗️
**TypeScript Version:** 5.4.0-dev.20231210
**Steps to reproduce crash**
1.
2.
3.
**TS Server Log**
❗️ Ser…
-
As for me no model is able to load anymore with versions higher then 2.x.
-
I am trying to fine-tune Phind 34B using Levanter on a TPU v4-8 VM. How can I implement QLoRA without getting an error telling me I must use full or half precision?
-
Let LLM think in English and ask to summarize JSON at the final step of the analysis.
I've found this one interesting:
-
when puzzle is coming, the check fails due to:
```text
`this.summary.value` is not a function when analyzing pdd
```
-
Take a look at this one: https://github.com/objectionary/eo/issues/3127#issuecomment-2069314142
Such a long report is absolutely useless. Nobody reads it and nobody pays attention. In order to be u…
-
## Basic information
- Board URL (official): https://www.arrow.com/en/products/c8380-12c-mp-32g/thu…
-
### What is the issue?
(Pythogora) developer@ai:~/PROJECTS/gpt-pilot/pilot$ ~/ollama/ollama list
NAME ID SIZE MODIFIED
Meta-Llama-3-70B-…
-
I am unable to connect to the server using CURL
**LocalAI version:**
```
./local-ai-avx-Linux-x86_64 --models-path /mnt/c/Users/dutta/Documents/GPT4AllModels/
9:35PM DBG no galleries to load
9:…