-
`run_for_local_option.sh`脚本里面路径有很多`/workspace/qanything_local`的硬编码，建议将这个提取成一个变量，方便修改。
-
### Issue
Not in the in-chat commands and can't run it with --architect
Here's all I can use, I'm using the latest version but doesn't seem like I have architect, has it been removed or something?…
-
### Describe your question
SuperSonic版本：0.9.2
`OPENAI_API_BASE=https://dashscope.aliyuncs.com/api/v1/apps/{我的app_id}/completion
OPENAI_API_KEY={我的api_key}
OPENAI_MODEL_NAME=Qwen-MAX`
报错信息：Excep…
-
# Trending repositories for C#
1. [**Jackett / Jackett**](https://github.com/Jackett/Jackett)
__API Support for your favorite torrent trackers__
13 stars today | 11,225 s…
-
### System Info
```
2024-11-06T04:38:58.950145Z INFO text_generation_launcher: Runtime environment:
Target: x86_64-unknown-linux-gnu
Cargo version: 1.80.1
Commit sha: b1f9044d6cf082423a517cf9a6a…
-
### Problem Description
I am going to use VLLM to start a QWEN model on an AMD GPU for testing. If I use a GPU to start it, it can start and use it normally. The log after startup is as follows:
`
…
-
### Your current environment
```text
PyTorch version: 2.3.0+cu121
Is debug build: False
CUDA used to build PyTorch: 12.1
ROCM used to build PyTorch: N/A
OS: Ubuntu 20.04.6 LTS (x86_64)
GCC …
-
### Your current environment
driver 1.17
vllm 0.5.3.post1+gaudi117
```text
export VLLM_GRAPH_RESERVED_MEM=0.1
export VLLM_GRAPH_PROMPT_RATIO=0.9
export VLLM_PROMPT_S…
-
### Your current environment
```text
The output of `python collect_env.py`
```
### 🐛 Describe the bug
This issue is introduced by `block_softmax` kernel(part of `flat_pa`, see #169 )
For some …
-
### Feature Name
Qwen LM
### Feature Description
Research about Qwen LM
### Research Findings
# Qwen Overview
Qwen is a series of advanced AI models developed by Alibaba Cloud, designed to handl…