-
### 📚 The doc issue
使用 python -m vllm.entrypoints.openai.api_server --host 0.0.0.0 --port 17003 --model /data/Qwen2-7B-Instruct-GPTQ-Int4 --served-model-name Qwen 命令 加载下载的Qwen2-7B-Instruct-GPTQ-…
-
**Describe the bug**
When I start vLLM OpenAI server with Meta Llama 3.1 8B instruct, it works.
```
python3 -m vllm.entrypoints.openai.api_server --model meta-llama/Meta-Llama-3.1-8B-Instruct
```
…
-
## Description
The stable doc here: https://docs.kedro.org/en/stable/integrations/pyspark_integration.html is out of date I think.
Specifically:
`parameters = context.config_loader.get("spark*"…
-
- Operating System: windows
- Node Version: 12
- NPM Version: 6
- webpack Version:5
- thread-loader Version:4
### Expected Behavior
I get this error when I use thread-loader before I use t…
-
Load model weight error when run with MiniCPM-V_2_6_awq_int4
vllm environment:
docker image: vllm/vllm-openai:v0.5.4
model download from:
git clone https://www.modelscope.cn/linglingdan/MiniCP…
-
Hello, dear developer, I encountered a problem when I first used this plug-in. Please see the log below.
Sep 01 01:07:42 steamdeck PluginLoader[993]: ValueError: GamepadUI Tab not found
Sep 01 01:…
-
### Prerequisites
- [X] I understand and accept the project's [code of conduct](https://github.com/PrestaShop/PrestaShop/blob/develop/CODE_OF_CONDUCT.md).
- [X] I have already [searched in existin…
-
### Your current environment
```text
The output of `python collect_env.py`
```
### 🐛 Describe the bug
error log
``` bash
AssertionError: Torch not compiled with CUDA enabled
- databricks/db…
-
After upgrading from 2.8.1 to 2.9.0 (and then 2.9.1), we're seeing this error repeatedly in the Chrome dev console. We didn't change any aspect of our config or css loading set-up.
![image](https:…
-
### Go version
go version go1.23.0 linux/amd64
### Output of `go env` in your module/workspace:
```shell
GO111MODULE='auto'
GOARCH='amd64'
GOBIN=''
GOCACHE='/home/user/.cache/go-build'
G…