-
### Describe the bug
Connecting to OpenLLM isn't an issue from the look of it, but actually using it from langchain is
### To reproduce
# code
from langchain_community.llms import OpenLLM
print…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
### Describe the bug
qwen1.5-32b-chat-awq-4bit 设…
-
Could you please share your requirements.txt file, thank you!
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
Package Version Editable project location
-------------------------------…
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
### Your current environment
```
PyTorch version: 2.2.1+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 22.04.4 LTS (x86_64)
GCC versio…
-
**LocalAI version:**
docker run -p 8080:8080 --gpus all --name local-ai -ti localai/localai:v2.11.0-aio-gpu-nvidia-cuda-12
**Environment, CPU architecture, OS, and Version:**
Linux rumpel 6.8…
-
### Describe the bug
When I try to merge my pr #508 it does not install the Triton package for Python 3.12, and I don't know really why.
https://github.com/openai/triton/issues/2707
![grafik](h…
-
### Checklist
- [X] 1. I have searched related issues but cannot get the expected help.
- [X] 2. The bug has not been fixed in the latest version.
### Describe the bug
运行下面的命令:
lmdeploy ser…
-
## Issue Description
Creating a new axis after using `associative_scan` with the int16 type raises an error. If the commented-out line of code is used instead of the problematic line, the code runs c…