search

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
https://lmdeploy.readthedocs.io/en/latest/
Apache License 2.0
3.11k stars 280 forks source link

bump version to v0.5.0 #1852

Open lvhan028 opened 4 days ago

QwertyJack commented 2 days ago

Could you please include Phi-3-Vision as well?

lvhan028 commented 2 days ago

Could you please include Phi-3-Vision as well?

Sorry, I cannot. We plan to release v0.5.0 on June, 27th. The main branch is frozen two days early for testing. Only fixing-bug PR will be accepted during the two days.

lvhan028 commented 2 days ago

You can try #1845 without compiling the turbomind engine, since phi3-vision is supported by pytorch engine. Checkout that PR and run the following commands to install lmdeploy

cd lmdeploy
pip install -e .