search

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.
https://lmdeploy.readthedocs.io/en/latest/
Apache License 2.0
4.33k stars 390 forks source link

[Bug] 判断条件检查 #1757

Closed seetimee closed 3 months ago

seetimee commented 3 months ago

Checklist

Describe the bug

https://github.com/InternLM/lmdeploy/blob/main/lmdeploy/serve/proxy/proxy.py里的 if min_latency < latency:这个判断条件是不是有点问题,应该是反过来吧

Reproduction

None

Environment

None

Error traceback

No response

lvhan028 commented 3 months ago

https://github.com/InternLM/lmdeploy/pull/1692 is addressing this issue.

AllentDan commented 3 months ago

Close since it was fixed.