Add Jetson platform support (by docker)

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

https://lmdeploy.readthedocs.io/en/latest/

Apache License 2.0

3.11k stars 280 forks source link

Open BestAnHongjun opened 1 week ago

BestAnHongjun commented 1 week ago

Added compilation support for Jetson platform based on Docker.

Warning: Only for collaborative testing, please do not merge into the main branch!

Test item: Jetpack 5. x has compilation issues. Please investigate compatibility with cuda 11.4.