alibaba / rtp-llm

RTP-LLM: Alibaba's high-performance LLM inference engine for diverse applications.
Apache License 2.0
544 stars 50 forks source link

support to run example/test.py on Arm #112

Closed TianyuLi0 closed 2 months ago

TianyuLi0 commented 2 months ago

To run the example: bazel test //example:test --config=arm --test_output=all