Closed LSC527 closed 1 month ago
File "/usr/local/lib/python3.10/dist-packages/lmdeploy/vl/templates.py", line 4, in <module>
pipe = pipeline(
This line is strange as line 4 is empty
Could you check this file (/usr/local/lib/python3.10/dist-packages/lmdeploy/vl/templates.py) contents?
Sry, my mistake. I was picking https://github.com/InternLM/lmdeploy/pull/2139 and copy some wrong code to lmdeploy/vl/templates.py
Thanks!
Checklist
Describe the bug
ImportError: cannot import name 'VLAsyncEngine' from partially initialized module 'lmdeploy.serve.vl_async_engine'
Reproduction
Environment
Error traceback