search

datarobot / datarobot-user-models

User's custom models boilerplate
Other
96 stars 85 forks source link

[AGENT-6033] Bump vllm env to 0.5.4 #1103

Closed elatt closed 2 months ago

elatt commented 2 months ago

This repository is public. Do not put here any private DataRobot or customer's data: code, datasets, model artifacts, .etc.

Summary

See full list of changes with vLLM in their release log: https://github.com/vllm-project/vllm/releases

Notable changes for us are Llama 3.1 support and also support for vision language models (i.e. MiniCPM-V)

Rationale

vLLM is rapidly evolving so we will want to bump our official env periodically for demoing.

engprod-2[bot] commented 2 months ago

The Needs Review labels were added based on the following file changes.

Team @datarobot/custom-models (#custom-models) was assigned because of changes in files:

public_dropin_gpu_environments/vllm/Dockerfile
public_dropin_gpu_environments/vllm/env_info.json

Team @datarobot/tracking-agent (#tracking-agent-reviews) was assigned because of changes in files:

public_dropin_gpu_environments/vllm/Dockerfile
public_dropin_gpu_environments/vllm/env_info.json

If you think that there are some issues with ownership, please discuss with C&A domain at #core-backend-domain slack channel and create PR to update DRCODEOWNERS\CODEOWNERS file.

devexp-slackbot[bot] commented 2 months ago

Label Needs Review: Custom Models was removed because @yakov-g is part of Custom Models domain.