datarobot / datarobot-user-models

User's custom models boilerplate
Other
96 stars 85 forks source link

[AGENT-6033 AGENT-6065] Bump version of vLLM env to v0.6.2 #1118

Closed elatt closed 1 month ago

elatt commented 2 months ago

This repository is public. Do not put here any private DataRobot or customer's data: code, datasets, model artifacts, .etc.

Summary

Rationale

The new vLLM supports more models and also has performance improvements. The new version of drum allows us to be more nible to vLLM change by allowing us to have more changes in the Dockerfile rather than needing to rely on DRUM code changes to support new vLLM versions. We have stopped installing autoawq because it wasn't compatible with the newest version of vLLM and also isn't needed for all cases.

devexp-slackbot[bot] commented 2 months ago

The Needs Review labels were added based on the following file changes.

Team @datarobot/custom-models (#custom-models) was assigned because of changes in files:

public_dropin_gpu_environments/vllm/Dockerfile
public_dropin_gpu_environments/vllm/dr_requirements.txt

Team @datarobot/tracking-agent (#tracking-agent-reviews) was assigned because of changes in files:

public_dropin_gpu_environments/vllm/Dockerfile
public_dropin_gpu_environments/vllm/dr_requirements.txt

If you think that there are some issues with ownership, please discuss with C&A domain at #core-backend-domain slack channel and create PR to update DRCODEOWNERS\CODEOWNERS file.

engprod-2[bot] commented 2 months ago

Label Needs Review: Tracking-Agent was removed because @dulcardo is part of Tracking-Agent domain.