-
**Describe the bug**
**问题描述**
A clear and concise description of what the bug is.
Any of the chat windows do not support continued conversations for local models. I'm not sure if this is a bug or…
-
### Issue you'd like to raise.
I was following the tutorial [here](https://python.langchain.com/docs/modules/memory/conversational_customization) and instead of OpenAI, I was trying to use a LLama2…
AvisP updated
3 months ago
-
Tracking updates of www.redditgifts.com
-
I'd like to automate a few tests to make sure a model works - ( with llama.cpp as a baseline )
Currently I can't seem to match Llama.cpp's answer... ( llama-cpp-rs answers incorrectly )
..tryi…
-
### What is the issue?
Was trying to run a finetuned version of llama2 having a gguf of 13.5gb.
![Screenshot from 2024-04-25 11-30-55](https://github.com/ollama/ollama/assets/163822058/99f79650-…
-
I am running GNU Guix with the following ROCm packages installed:
```
$ guix package -I rocm
rocm-device-libs 5.6.0 out /gnu/store/jrkc3924g178yfvqlwqzq9d3pmxc9jlg-rocm-device-libs-5.6.0
rocm…
-
Hi!
Trying to run the server with more slots that 6 by setting the parameters -np and -cb like this:
./server -m models/mixtral-8x7b-instruct-v0.1.Q5_K_M.gguf --host 0.0.0.0 --ctx_size 8192 -t 8…
-
I've reviewed the great tutorial made by @bnodnarb here:
https://github.com/jmorganca/ollama/blob/main/docs/tutorials/nvidia-jetson.md
The Orin Nano is running Ubuntu 20.04 with Jetpack 5.1.2 (r35…
-
I really enjoyed the examples for running whisper.cpp on iOS using both objective-c and swift-ui (found at https://github.com/ggerganov/whisper.cpp/tree/master/examples/whisper.objc and https://github…
-
### Bug description
I am attempting to make use of the Bitsandbytes precision plugin as found here:
https://lightning.ai/docs/pytorch/2.1.0/api/lightning.pytorch.plugins.precision.BitsandbytesPrecis…