-
how to use onnx model for Phi-3 mini 128k for faster inference for local machine having cpu only. Can you provide the code to do it.
-
#### Describe the bug
when I try to use OpenDevin, it just gets stuck in a loop and doesn't actually do anything.
#### Setup and configuration
**Current version**:
```bash
a9f469f0e736809…
-
### Feature Description
Support sending a stream of JSON-patch like events with `streamObject` to enable more efficient end-to-end workflows and complex scenarios involving eliding some content fro…
-
**What problem or use case are you trying to solve?**
Can't run using local models
**Describe the UX of the solution you'd like**
No way to set api_base
**Do you have thoughts on the tech…
-
### Feature Description
Implement Language Agent Tree Search (LATS) agent in llama-index
The original paper is here: https://arxiv.org/pdf/2310.04406.pdf
Github implementation: https://github.com…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
### Checked other resources
- [X] I added a very descriptive title to this issue.
- [X] I searched the LangChain documentation with the integrated search.
- [X] I used the GitHub search to find a sim…
-
I'm interested in this model as a catch all for a project I am working on similar to Devin.
I think as Devin like clones, and similar apparatuses become available terminal commands will also have a h…
-
```
runnable = PROMPT | self.llm
new_chunk_summary = runnable.invoke({
"proposition": proposition
}).content
```
ERROR: 'str' object has no attribute 'content'
Have you seen this before? …
-
I host Open WebUI on a small server at home. I connect various inference providers to it, such as OpenRouter and OpenAI. Additionally, I have a gaming rig with an RTX 3090 GPU, which I only power on w…