-
see [huggingface](https://huggingface.co/collections/microsoft/phi-3-6626e15e9585a200d2d761e3) for the models
-
### What happened?
System: Mac M1, latest OS (14.5), latest llama.cpp (b3204), build in a std. way (make).
Path to reproduce: start llama server with --embeddings (tested with llama3/8b/fp16 and mis…
-
### Your current environment
```text
ollecting environment information...
PyTorch version: 2.3.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
O…
-
### What is the issue?
The command "ollama list" does not list the installed models on the system (at least those created from a local GGUF file), which prevents other utilities (for example, WebUI) …
-
### System Info
Cuda : 12.1
OS : Windows x64
pip : 24.0
python : 3.10.10
transformers : 4.40.0
bitsandbytes: 0.43.1
### Who can help?
Hey, @ArthurZucker @younesbelkada I am getting a con…
-
### Bug Report
- I am playing around with a Nobara Linux OS installation (based on Fedora 39) and I just tried one of my older gguf's (mistral-7b-code-16k-qlora.Q4_K_M.gguf) and it crashes GPT4All …
-
**Describe the bug**
The latest version of main does not compile on Mac OS. Here is what I see:
```
% cargo run --release --features metal -- -i plain -m microsoft/Phi-3-mini-128k-instruct -a ph…
-
```
Would like to see a Macintosh Port of PeerBlock.
Currently running 10.6 Snow Leopard.
Thanks!
```
Original issue reported on code.google.com by `brando...@gmail.com` on 12 Oct 2009 at 9:47
-
hi , i am following a tutorial here is the github link of same https://github.com/leonvanzyl/langchain-js/blob/lesson-4/retrieval-chain.js , every thing works till lesson 3 , in lesson 4 i am using th…
-
### Describe the issue as clearly as possible:
When I try to use Hermes-Pro-7b with llama-cpp-python, I cannot use `cfg` to generate structured grammar
This is ONLY an issue with structured gramma…