chore(deps): bump vllm from 0.4.0 to 0.4.2 in /openllm-python

[dependabot[bot]]

Bumps vllm from 0.4.0 to 0.4.2.

Release notes

Sourced from vllm's releases.

v0.4.2

Highlights

Features

• Chunked prefill is ready for testing! It improves inter-token latency in high load scenario by chunking the prompt processing and priortizes decode (#4580)
• Speculative decoding functionalities: logprobs (#4378), ngram (#4237)
• Support FlashInfer as attention backend (#4353)

Models and Enhancements

• Add support for Phi-3-mini (#4298, #4372, #4380)
• Add more histogram metrics (#2764, #4523)
• Full tensor parallelism for LoRA layers (#3524)
• Expanding Marlin kernel to support all GPTQ models (#3922, #4466, #4533)

Dependency Upgrade

• Upgrade to torch==2.3.0 (#4454)
• Upgrade to tensorizer==2.9.0 (#4467)
• Expansion of AMD test suite (#4267)

Progress and Dev Experience

• Centralize and document all environment variables (#4548, #4574)
• Progress towards fully typed codebase (#4337, #4427, #4555, #4450)
• Progress towards pipeline parallelism (#4512, #4444, #4566)
• Progress towards multiprocessing based executors (#4348, #4402, #4419)
• Progress towards FP8 support (#4343, #4332, 4527)

What's Changed

• [Core][Distributed] use existing torch.cuda.device context manager by @​youkaichao in vllm-project/vllm#4318
• [Misc] Update ShareGPT Dataset Sampling in Serving Benchmark by @​ywang96 in vllm-project/vllm#4279
• [Bugfix] Fix marlin kernel crash on H100 by @​alexm-nm in vllm-project/vllm#4218
• [Doc] Add note for docker user by @​youkaichao in vllm-project/vllm#4340
• [Misc] Use public API in benchmark_throughput by @​zifeitong in vllm-project/vllm#4300
• [Model] Adds Phi-3 support by @​caiom in vllm-project/vllm#4298
• [Core] Move ray_utils.py from engine to executor package by @​njhill in vllm-project/vllm#4347
• [Bugfix][Model] Refactor OLMo model to support new HF format in transformers 4.40.0 by @​Isotr0py in vllm-project/vllm#4324
• [CI/Build] Adding functionality to reset the node's GPUs before processing. by @​Alexei-V-Ivanov-AMD in vllm-project/vllm#4213
• [Doc] README Phi-3 name fix. by @​caiom in vllm-project/vllm#4372
• [Core]refactor aqlm quant ops by @​jikunshang in vllm-project/vllm#4351
• [Mypy] Typing lora folder by @​rkooo567 in vllm-project/vllm#4337
• [Misc] Optimize flash attention backend log by @​esmeetu in vllm-project/vllm#4368
• [Core] Add shutdown() method to ExecutorBase by @​njhill in vllm-project/vllm#4349
• [Core] Move function tracing setup to util function by @​njhill in vllm-project/vllm#4352
• [ROCm][Hardware][AMD][Doc] Documentation update for ROCm by @​hongxiayang in vllm-project/vllm#4376
• [Bugfix] Fix parameter name in get_tokenizer by @​DarkLight1337 in vllm-project/vllm#4107
• [Frontend] Add --log-level option to api server by @​normster in vllm-project/vllm#4377
• [CI] Disable non-lazy string operation on logging by @​rkooo567 in vllm-project/vllm#4326
• [Core] Refactoring sampler and support prompt logprob for chunked prefill by @​rkooo567 in vllm-project/vllm#4309
• [Misc][Refactor] Generalize linear_method to be quant_method by @​comaniac in vllm-project/vllm#4373
• [Misc] add RFC issue template by @​youkaichao in vllm-project/vllm#4401
• [Core] Introduce DistributedGPUExecutor abstract class by @​njhill in vllm-project/vllm#4348

... (truncated)

Commits

• c7f2cf2 [CI] Reduce wheel size by not shipping debug symbols (#4602)
• 8d8357c bump version to v0.4.2 (#4600)
• 4302987 [Bugfix] Fix inappropriate content of model_name tag in Prometheus metrics (#...
• 021b1a2 [CI] check size of the wheels (#4319)
• 2a05201 [Kernel] Support MoE Fp8 Checkpoints for Mixtral (Static Weights with Dynamic...
• 36fb68f [Doc] Chunked Prefill Documentation (#4580)
• bc8ad68 [Misc][Refactor] Introduce ExecuteModelData (#4540)
• 344bf7c [Misc] add installation time env vars (#4574)
• ab50275 [Speculative decoding] Support target-model logprobs (#4378)
• 43c413e [Kernel] Use flashinfer for decoding (#4353)
• Additional commits viewable in compare view

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.

---

Dependabot commands and options

You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)

[dependabot[bot]]

Looks like vllm is up-to-date now, so this is no longer needed.