search

RulinShao / LightSeq

Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
179 stars 8 forks source link

Same name paper #1

Closed SeanLi-OI closed 10 months ago

SeanLi-OI commented 10 months ago

Just a friendly reminder: there are two other papers titled "LightSeq" in ACL'21 and "LightSeq2" in SC'22. https://arxiv.org/pdf/2010.13887.pdf https://arxiv.org/pdf/2110.05722.pdf

You've done a great work in accelerating distributed training on sequence level parallelism, perhaps considering a different name would be beneficial.

DachengLi1 commented 10 months ago

@SeanLi-OI Thanks a lot for the reminder! Yes, we recently also came across these two great papers. We will consider it, thanks!