pentium3 / sys_reading

system paper reading notes
229 stars 12 forks source link

HeteGen: Heterogeneous Parallel Inference for Large Language Models on Resource-Constrained Devices #358

Open pentium3 opened 3 months ago