issues
search
RulinShao
/
LightSeq
Official repository for LightSeq: Sequence Level Parallelism for Distributed Training of Long Context Transformers
168
stars
8
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
Add requirements.txt
#12
AshkanFeyzollahi
opened
1 month ago
0
pip requirements
#11
kuangdao
opened
1 month ago
1
The test results of “fastckpt” are not as expected
#10
LzhinFdu
opened
2 months ago
1
error when use huggingface trainer
#9
linyubupa
opened
3 months ago
0
Runtime Error when testing on H100
#8
yihaocs
closed
3 months ago
3
Megatron-LM’s communication
#7
wangpengfei1013
closed
3 months ago
2
does it support mixtral_8x7b model?
#6
strngelet
opened
5 months ago
0
how to use your code in other models?
#5
zxgx
closed
6 months ago
3
Fix outdated package name
#4
66RING
closed
7 months ago
0
About Megatron-LM sequence length
#3
ZhongYingMatrix
closed
8 months ago
1
varlen dist_attn kernel
#2
RulinShao
closed
9 months ago
0
Same name paper
#1
SeanLi-OI
closed
9 months ago
1