-
## Expected Behavior
The following Lambda typescript code should work even when the DD instrumentation and layer have been enabled. Variables assumeRoleArn and region are set higher up in the execu…
-
### What happened?
I've already quantized a 2b variant of this model, and one of its instruct fine tune, on a subset of the same data (the first 1000 samples are the same in the same order -- the e…
-
Hi @mirzak can you create the relevant branch for kirkstone? Such as all Yocto related layers do, so as to have it clearer which Yocto release your board is supporting, aside from https://github.com/m…
-
### What happened?
Hi, im trying to use Google [Madlad400 in GGUF version,](https://huggingface.co/NikolayKozloff/madlad400-10b-mt-Q8_0-GGUF) but I'm unable to work it with `llama-server` but it work…
-
### What is the issue?
The results generated by cli terminal:
The results generated by open webui:
![webui…
-
### What happened?
Going through the manual - SYCL I mean. Everything compiles okay. Running it always thows an error. Can't make it work. OS used: Linux Gentoo. P.S. docker doesn't work either. P.P.…
-
### What is the issue?
embedding model
When I submit a single fragment, it responds normally, but when I submit multiple fragments, an exception occurs.
I encountered this error on different Wind…
-
**kas-example.yml**:
```
header:
version: 11
machine: qemux86-64
distro: poky
target:
- core-image-minimal
repos:
poky:
url: "https://git.yoctoproject.org/git/poky"
branch: …
-
The goal of this issue is to incorporate `eclipes-ankaios` into `meta-leda` layer, specifically in `meta-leda/meta-leda-components/recipes-sdv` layer for Yocto Project.
Eclipes Ankaios provides wo…
-
### Jan version
0.5.7
### Describe the Bug
Using Jan v0.5.7 on a Mac with an M1 processor, running Llama 3.2 3B instruct q8 via the API. Occasionally, the server stops responding to POST requ…