-
For implementing a highly available embedded KV storage with DLedger, consider applying HPK to these local maps, such as HashMap.Does this consider HPPC high-performance HashMaps here?
-
### What is the issue?
See the following llama.cpp issues/PRs:
* [PR 6920](https://github.com/ggerganov/llama.cpp/pull/6920): llama : improve BPE pre-processing + LLaMA 3 and Deepseek support
* […
-
### What is the issue?
Until v0.1.38 version my setup has 9 token/s but since the v0.1.39 to the actual v0.1.48 and v0.2 version it reduce the performance to 0.12 token/s
My setup:
- Intel(R) Cor…
-
### What is the issue?
Upon running "ollama run gemma:2b" (though this happens for all tested models: llama3, phi, tinyllama), the loading animation appears and after ~5 minutes (estimate, untimed)…
-
you can fully replace keyDB with NATS Stream. https://github.com/nats-io
Its 100% golang and fully open. It can scale globally to multi data center in a multi master fashion.
The KV store is a c…
-
We could build a fast local KV storage for the hitchhiker tree, so that it can run as an embedded persistent Datomic-like DB for local applications.
-
Currently, command history is remembered within a session, but forgotten as soon as Phoenix closes. It'd be nice if this could be preserved.
-
### What is the issue?
I've noticed there are other recent issues on offloading, however, since I'm using a different setup I thought opening a seperate issue would make sense. I neither use docker…
-
### Bug Description
I was trying to do Tree Summarize with llamacpp and Mistral-7b. However, I encountered an issue where the model has a default BOS token embedded. When I use promptemplate a BOS …
-
I found this repo by hunting for updates to my [Awesome Cloudflare Workers](https://github.com/tomByrer/awesome-cloudflare-workers). Today I also found out about [Cloudflare's sites](https://workers.…