-
I convert the TRT engine with following
https://github.com/yusing/ComfyUI_TensorRT/blob/master/workflows/Build.TRT.Engine_SDXL_Base_Static.json
and vae use following to generate safetensors
https:/…
-
Hi Lorenz,
Thanks for the cool work! I know "rendering depth" is on your to-do list, but I'm wondering if you have any quick pointers on how to implement this function inside your current code base…
-
Hello,
First, thanks for providing such a great resource to the community.
I've been encountering an error when I attempt to use Hmsc-HPC to fit a spatial model (i.e. with spatially explicit ran…
-
### Your current environment
```text
"image": "vllm/vllm-openai:latest"
"options": "runtime=nvidia gpus=1 ipc=host"
"--port=8000
--model=meta-llama/Meta-Llama-3-8B-Instruct
--tensor-parallel-s…
-
# Overview
Static samplers are immutable sampler objects that can not be modified after they are defined. They exist in all three backends: Vulkan, D3D12, and Metal. They are called immutable sampler…
-
### Game Name
Fortnite
### Game code
CUSA07022
### Game version
v01.01
### Used emulator's version (only released versions are acceptable)
v0.2.0
### Current status
Boots
### Error
[Render.…
-
### Your current environment
[root@localhost wangjianqiang]# python -m vllm.entrypoints.openai.api_server --model /root/wangjianqiang/deepseek-moe/deepseek-coder-33b-base/ --tensor-parallel-size 8 …
-
### 是否已有关于该错误的issue或讨论? | Is there an existing issue / discussion for this?
- [X] 我已经搜索过已有的issues和讨论 | I have searched the existing issues / discussions
### 该问题是否在FAQ中有解答? | Is there an existing ans…
-
硬件环境:4090+i9-14900f
操作系统:ubuntu 22.04
环境:python 3.8,vllm 0.5.5,vllm-flash-attn 2.6.1,transformers 4.45.0.dev0
问题描述:使用conda创建python3.8的环境后使用pip安装了vllm,模型权重文件也下载到了本地。然后执行启动命令”python -m vllm.entrypoin…
-
We want to run Jmeter web driver sampler for real time browser load test so since we dont have control over load engine to copy the web driver exe , therefore we assume that these load engine are one …