-
**The bug**
A clear and concise description of what the bug is.
```
---------------------------------------------------------------------------
TypeError Tracebac…
-
**Describe the bug**
It appears with ilab v0.17.0 that ilab convert no longer works
**To Reproduce**
Steps to reproduce the behavior:
1: ilab generate
2: ilab trian
3: ilab convert
Give the…
-
### Before submitting your bug report
- [X] I believe this is a bug. I'll try to join the [Continue Discord](https://discord.gg/NWtdYexhMs) for questions
- [X] I'm not able to find an [open issue](ht…
-
## What
Add Ollama in as an LLM option.
## Why
Many people run local LLMs, and then knowledge table can be run without an internet connection.
## Implementation guidance
The FastAPI b…
-
When i run talk-llama like this:
```bash
./talk-llama -t 8 -l ru --person Myname -mw models/ggml-base.bin -ml ../llama.cpp/models/ggml-wizardlm-7b-q5_1.bin --prompt-file examples/talk-llama/prompts/…
-
### Feature request / 功能建议
[MiniCPM](https://github.com/OpenBMB/MiniCPM)真的是好用的感动的我要哭!!强烈请求尽快出Ollama模型,最好是能在ollama官网上上线,兼容最新版ollama。先谢过了哪位大神了~
-
![image](https://github.com/abetlen/llama-cpp-python/assets/77459670/8b1e28bd-0ef6-43bd-9f9d-861f15a281f5)
Setup:
-Cmake
-MinGW
-Windows 10
I earlier managed to compile llama.cpp on it's own, b…
-
### What model would you like?
Till now, ollama supports LLM and embedding models. I wonder if it could support popular reranking models later?
Such as:
1. [BAAI/bge-reranker-large](https://huggi…
-
I am constantly facing the issue unable to build wheel for llama-cpp-py when i install the requirements.
I get this error on every try:
> An error occurred while building with CMake.
…
-
Blog
https://medium.com/@obrienlabs/running-the-70b-llama-2-llm-locally-on-metal-via-llama-cpp-on-mac-studio-m2-ultra-32b3179e9cbe
https://www.linkedin.com/posts/michaelobrien-developer_running-70b-…