-
## What
Add Ollama in as an LLM option.
## Why
Many people run local LLMs, and then knowledge table can be run without an internet connection.
## Implementation guidance
The FastAPI b…
-
## Goal-State/What/Result
The following AI/LLM functionality is covered by integration and end-to-end (E2E) tests, allowing us to release and update it with high confidence, while preventing and dete…
-
### Your current environment
The output of `python collect_env.py`.
```text
Collecting environment information...
PyTorch version: 2.4.0+cu121
Is debug build: False
CUDA used to build PyT…
-
### System Info
- GPU： NVIDIA H100 80G
- TensorRT-LLM branch main
- TensorRT-LLM commit: 8681b3a4c0ccc1028bb48d83aacbb690af8f55e7
### Who can help?
@byshiue @juney-nvidia @ncomly-nvidia
### Infor…
-
Question [not an issue]:
Thank you for this amazing plugin in Eclipse.
I want to ask if I can use this plugin with a local model that is exposed with an endpoint, because we don't want to leak our …
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
### System Info
a100
### Who can help?
@Tracin
### Information
- [x] The official example scripts
- [ ] My own modified scripts
### Tasks
- [x] An officially supported task in the `examples` …
-
### System Info
Windows 11
Python 3.11.4
pandasai 2.0.24
### 🐛 Describe the bug
I was using PandasAI, and it was working perfect. But , out of the blue it stops working, and it's not working anym…
-
Is it possible to use a custom link for endpoints like [**koboldcpp**](https://github.com/LostRuins/koboldcpp) or [**LM Studio**](https://lmstudio.ai/) so that a local LLM model can be utilized?
Will…
-
### Is there an existing issue for the same bug?
- [X] I have checked the existing issues.
### Describe the bug and reproduction steps
I'm tring local ollama qwen2.5coder 32b model. Agent tried to …