-
**LocalAI version:**
Latest
**Environment, CPU architecture, OS, and Version:**
EC-2
**Describe the bug**
Getting the grpc connection error when running using cuda12 image. But when runni…
-
File "/root/.local/lib/python3.12/site-packages/vlmeval/dataset/image_mcq.py", line 181, in evaluate
answer_map = {i: c for i, c in zip(meta['index'], meta['answer'])}
…
-
# Trending repositories for C#
1. [**icsharpcode / ILSpy**](https://github.com/icsharpcode/ILSpy)
__.NET Decompiler with support for PDB generation, ReadyToRun, Metadata (&more) -…
-
在这里能获取到上下文信息吗？添加额外的参数实现FIM
-
### 是否已有关于该错误的issue或讨论？ | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答？ | Is there an existing ans…
-
There was a previous thread but I didnt see a resolution, running into this issue:
OS: Ubuntu 20.04
CUDA Version: 11.2
CPU: 30
CPU RAM: 200
GPU: 8, Tesla V100-SXM2
```
vllm = LLM(model="mo…
-
我按照官网的示例加载百川模型，尝试给chat方法传递temperature参数时报如下错误：
关键代码如下：
···python
from transformers import…
-
### System Info
Command Causing Issue:
```
model=microsoft/Phi-3-mini-4k-instruct
volume=$PWD/data # share a volume with the Docker container to avoid downloading weights every run
docker run -…
-
### Reminder
- [X] I have read the README and searched the existing issues.
### System Info
$ llamafactory-cli env
[2024-10-08 20:23:42,657] [INFO] [real_accelerator.py:203:get_accelerator] Setti…
-
### Description
While investigating my problems how to make LiteLLM use OpenAI compatible APIs with structured output as reported in [Issue 1333](https://github.com/crewAIInc/crewAI/issues/1333), I…