[llm_perf] optimzie llm_perf code structure

bytedance / ByteMLPerf

AI Accelerator Benchmark focuses on evaluating AI Accelerators from a practical production perspective, including the ease of use and versatility of software and hardware.

https://bytemlperf.ai/

Apache License 2.0

188 stars 50 forks source link

[llm_perf] optimzie llm_perf code structure #79

Closed suisiyuan closed 3 months ago

suisiyuan commented 3 months ago

fix some known issues, replace torchrun with mp_engine to support custom vendor implementation.

suisiyuan commented 3 months ago

prepare for merge