Add reproduce scripts for seq len 256

FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.

Apache License 2.0

9.21k stars 547 forks source link

Closed Ying1123 closed 1 year ago