-
-
Hi Team,
Thank you for sharing code and data. In figure 4 (a), the xticks labels for 39&40, 41&42 are not properly mapped to category names.
41 and 42 - Corresponds to privacy violations as per…
-
自建服务器，仙人掌连接后，一声“蹬蹬”音后无反应，emqx后台在浏览器也无法打开
端口测试已经联通
测试方案：
tcp端口：1883、8082、18083、8083
命令：```telnet ```
返回：
```
Trying ...
Connected to .
Escape character is '^]'.
```
1~2s后
```Connec…
-
Are you kidding us?
there isn't any model there, the model that are linked on running app is gpt4
\`\`\`
I'm OpenAI's GPT-4, the latest version of our advanced language generation model. I'm de…
-
### Your current environment
I'm encountering an AssertionError when trying to load the Qwen 2.5 GGUF (Qwen-2.5-q3_gguf.bin) model using vLLM. The error occurs in the vocab_parallel_embedding.py file…
-
### Describe the bug
I am running self-hosted Qwen2.5 model, and use LiteLLM as the proxy to serve applications. LangFuse was configured as the monitoring tool in LiteLLM. Everything is working perfe…
-
### 📦 部署环境
Other
### 📌 软件版本
v1.5.1
### 💻 系统环境
Windows, iOS
### 🌐 浏览器
Edge, Safari
### 🐛 问题描述
目前部署在Azure北美容器应用上，一直存在类似 #3108 的问题，但早期无论是否打开客户端请求模式都存在问题。目前最新版本v1.5.1已默认关闭客户端请求模…
-
Really helpful project! However, I met some problem When I turn off WI-FI connection.
- OS: Windows10 LTSC
- cpu: R7-7840H
- Language: Python
```
Traceback (most recent call last):
File "c:\…
-
vLLM version 0.60 is claiming a major uplift in speed and performance https://blog.vllm.ai/2024/09/05/perf-update.html . This is consistent to my observation in a runs in a100 instances in vastai and …
-
**问题描述 / Problem Description**
用简洁明了的语言描述这个问题 / Describe the problem in a clear and concise manner.
在4090服务器上，重排序模型耗时2s以内，但是项目部署到A100上，重排序模型耗时5s多，这是为什么呢
**预期的结果 / Expected Result**
描述应该出现的结果 / D…