-
### Description
Hi, I am using the latest version of LLamaSharp and my model is Llama-3 70b gguf version, when the number of GpuLayerCount is 0 to 5, although it is not very fast, I get the answer, b…
-
### What is the issue?
2024/09/11 01:57:28 routes.go:1125: INFO server config env="map[CUDA_VISIBLE_DEVICES: GPU_DEVICE_ORDINAL: HIP_VISIBLE_DEVICES: HSA_OVERRIDE_GFX_VERSION:10.3.2 OLLAMA_DEBUG:fals…
-
Hello,
I noticed that this distro previously supported x86_64 CPUs in older branches. The meta-intel layer is still present in the submodules; however, the configuration files for these CPUs seem t…
-
**Description**
**Steps to reproduce the issue:**
1. mkdir riscv-yocto && cd riscv-yocto
repo init -u https://github.com/riscv/meta-riscv -b master -m tools/manifests/riscv-yocto.xml
…
-
When updating a petalinux environment via `petalinux-config --get-hw-description .` I get an IndexError at your scripts in the post-process phase.
I added some smaller print statements inside the fil…
-
The official ollama supports this model in v0.3.4
[https://github.com/ollama/ollama/releases/tag/v0.3.4](https://github.com/ollama/ollama/releases/tag/v0.3.4)
Tried with ollama in 2.1.0b20240820, …
-
Hello!
Commit `2badd76` appears to break `examples.models.llama2.export_llama`, specifically with Llama 3.
### Expected Behavior
```
[INFO 2024-06-14 16:04:23,366 export_llama_lib.py:390] Ap…
amqdn updated
2 months ago
-
I am having a problem that I detail in the following stackoverflow [post](https://stackoverflow.com/questions/70767215/meta-qt5-layer-issue-yocto-workflow) in which I define the enviroment and attach …
-
I'm noticing with v0.3.2 my CPU is getting slaughtered. The UI revamp is worse than the previous iteration with GPU offload now hidden on "My Models" page but even with all the layers assigned to GPU …
-
Steps to reproduce:
- fill `layers:` section of manifest with sample layer names, e.g.:
```
[..]
layers:
- "poky/meta"
- "poky/meta-poky"
- "poky/meta-yocto-bsp"
…