bentoml / OpenLLM

Run any open-source LLMs, such as Llama 3.1, Gemma, as OpenAI compatible API endpoint in the cloud.
https://bentoml.com
Apache License 2.0
9.7k stars 616 forks source link

chore(deps): bump vllm from 0.4.0 to 0.4.0.post1 in /openllm-python #953

Closed dependabot[bot] closed 4 months ago

dependabot[bot] commented 4 months ago

Bumps vllm from 0.4.0 to 0.4.0.post1.

Release notes

Sourced from vllm's releases.

v0.4.0.post1, restore sm70/75 support

Highlight

v0.4.0 lacks support for sm70/75 support. We did a hotfix for it.

What's Changed

New Contributors

Full Changelog: https://github.com/vllm-project/vllm/compare/v0.4.0...v0.4.0.post1

Commits
  • a3c226e [CI/Build] 0.4.0.post1, fix sm 7.0/7.5 binary (#3803)
  • b321d48 [Bugfix] Add __init__.py files for vllm/core/block/ and `vllm/spec_decode...
  • ad6eca4 Fix early CUDA init via get_architecture_class_name import (#3770)
  • 205b949 [CI/Build] fix TORCH_CUDA_ARCH_LIST in wheel build (#3801)
  • 3bec41f [Doc] Fix vLLMEngine Doc Page (#3791)
  • 0739b19 [Frontend][Bugfix] allow using the default middleware with a root path (#3788)
  • 77a6572 [HotFix] [CI/Build] Minor fix for CPU backend CI (#3787)
  • 0e3f06f [Hardware][Intel] Add CPU inference backend (#3634)
  • eb69d68 [Misc] [CI/Build] Speed up block manager CPU-only unit tests ~10x by opting-o...
  • 7d4e1b8 [Misc] Add support for new autogptq checkpoint_format (#3689)
  • Additional commits viewable in compare view


Dependabot compatibility score

Dependabot will resolve any conflicts with this PR as long as you don't alter it yourself. You can also trigger a rebase manually by commenting @dependabot rebase.


Dependabot commands and options
You can trigger Dependabot actions by commenting on this PR: - `@dependabot rebase` will rebase this PR - `@dependabot recreate` will recreate this PR, overwriting any edits that have been made to it - `@dependabot merge` will merge this PR after your CI passes on it - `@dependabot squash and merge` will squash and merge this PR after your CI passes on it - `@dependabot cancel merge` will cancel a previously requested merge and block automerging - `@dependabot reopen` will reopen this PR if it is closed - `@dependabot close` will close this PR and stop Dependabot recreating it. You can achieve the same result by closing it manually - `@dependabot show ignore conditions` will show all of the ignore conditions of the specified dependency - `@dependabot ignore this major version` will close this PR and stop Dependabot creating any more for this major version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this minor version` will close this PR and stop Dependabot creating any more for this minor version (unless you reopen the PR or upgrade to it yourself) - `@dependabot ignore this dependency` will close this PR and stop Dependabot creating any more for this dependency (unless you reopen the PR or upgrade to it yourself)
dependabot[bot] commented 4 months ago

Superseded by #969.