[Feature] Can use --tp 8 argument running on one machine 8 Ascend NPU(910B)?

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

https://lmdeploy.readthedocs.io/en/latest/

Apache License 2.0

4.63k stars 426 forks source link

Closed zhuzcalex closed 1 month ago

zhuzcalex commented 1 month ago

Can use --tp 8 argument running on one machine 8 Ascend NPU(910B)?

No response

No response

jinminxi104 commented 1 month ago

Yes, it works on our machine. Any errors occured on your machine?