-
### What are you trying to do?
I want use multilingual-e5-large or multilingual-e5-base as embedding model, because all other embed models dont work for other languages as english.
### How should we…
-
In the anchor_target_layer of model_train.py, using tf.py_func operator which enables you to run arbitrary Python code in the middle of a TensorFlow graph. However, tf.py_func is not supported in Ten…
-
ALBERT :A lite BERT for self-supervised learning of language representations
-
### Your current environment
When I set `VLLM_TENSOR_PARALLEL_SIZE = 2`, it works well. But when I change it to 4, vllm can not support Phi3-medium-*.
```
torch=2.3.0
vllm=0.5.0.post1
transform…
-
### _TFX RFP 001 - Request for community comments and proposals_
# Adding Non-Transform Feature Engineering
_An explanation of a specific critical user journey (CUJ) for windowing, and a general…
-
### Anything you want to discuss about vllm.
I am profiling TTFT and TPOT on my machine, I could not explain the behavior of TTFT thus opened this issue to seek for advice.
Below figure shows the …
-
### System information
j
### Code to reproduce issue
bb
### Describe the problem
I want to deploy a mlflow spark app to sagemaker. Is this possible? As I sucessfully push a image to ECR…
-
Hi there. Thanks for the excellent work. We are shocked by such a huge performance improvement.
When reproducing the results, I encountered the following problems. I'd be very appreciative if you cou…
-
### win11专业版下安装wsl2,wsl下安装docker desktop,在镜像中运行pytorch代码报错
启动镜像命令
```
docker run -itd --privileged --device=/dev/dri -v /c//models:/llm/models -v /usr/lib/wsl:/usr/lib/wsl --name=arc_vllm --s…
-
# Feature Request
Add a health check to the Dockerfile
## Describe the problem the feature is intended to solve
I'm using a docker container on an edge device and would like to be able to shut it…