-
Encounter error when running qwen2-VL in ipex-llm processing input video with big frame number, below is detail error message and code, video attached as well.
Error information
```
File "/…
-
### Feature summary
Currently this project use lot of LLM for answering questions
### Feature description
some of the goal of these tests should be
1. Testing of RAG - tests ensuring RAG data, it …
-
### System Info
TensorRT-LLM v0.13.0
### Who can help?
_No response_
### Information
- [ ] The official example scripts
- [ ] My own modified scripts
### Tasks
- [ ] An officially supported tas…
-
## 🐛 Bug
## To Reproduce
Steps to reproduce the behavior:
1. 编译
mlc_llm compile /path/to/internl…
-
-
### **Description**
When attempting to use the `llm` command-line interface (CLI) on Windows, I encounter an encoding error related to the ASCII codec. Despite setting environment variables to enfo…
-
**Describe the bug**
I'm trying to run letta in docker connected to an ollama service running on the same host. I'm using an .env file with the following vars:
LETTA_LLM_ENDPOINT=http://192.168.xx.x…
-
Hi,
First of all, thank you for the great work.
I am trying the llama example script with llama2-7b-hf and the following key packages:
```
torch 2.5.0
torchpippy …
-
Inspired by [a post on a telegram channel](https://t.me/EFW_inno/4140), our bot should incorporate a similar feature.
-
In `~/Library/Application Support/io.datasette.llm/extra-openai-models.yaml`, I have this:
```
- model_id: or:c35s
model_name: anthropic/claude-3.5-sonnet:beta
api_base: "https://openrouter.ai…