Fast Distributed Inference Serving for Large Language Models - Githubissues

pentium3 / sys_reading

system paper reading notes

235 stars 12 forks source link

Fast Distributed Inference Serving for Large Language Models #351

Open pentium3 opened 8 months ago

pentium3 commented 8 months ago

https://arxiv.org/pdf/2305.05920.pdf

pentium3 commented 8 months ago

https://zhuanlan.zhihu.com/p/648759542