issues
search
AlibabaPAI
/
torchacc
PyTorch distributed training acceleration framework
Apache License 2.0
32
stars
3
forks
source link
issues
Newest
Newest
Most commented
Recently updated
Oldest
Least commented
Least recently updated
fix qwen-vl failed with FSDP
#30
Yancey1989
opened
6 days ago
0
Optimize the image building script
#29
anw90
closed
3 days ago
0
support offline consolidate and reshard fsdp checkpoints
#28
hanwen-sun
closed
3 weeks ago
0
Update the docker image repository address
#27
anw90
closed
1 month ago
0
fix: add gradient gathering after input split in Context Parallel
#26
baoleai
closed
1 month ago
0
使用self.model = torchacc.accelerate(model)加速模型训练的时，GPU利用率极低，接近于0
#25
a1342772
opened
1 month ago
1
Add memory visualization tool
#24
lausannel
closed
1 month ago
0
Support varlen FlashAttention
#23
Seventeen17
opened
1 month ago
0
Support compute dtype in spmd fsdp
#22
lausannel
closed
1 month ago
0
add contact group
#21
baoleai
closed
1 month ago
0
xlarun --nproc_per_node=8 YOUR_MODEL.py
#20
a1342772
opened
1 month ago
6
update readme
#19
baoleai
closed
1 month ago
0
What is the difference between pai-torchacc and torchacc?
#18
a1342772
opened
2 months ago
2
Support eager backend and liger kernel
#17
yitongh
closed
1 month ago
0
support save&load of fsdp_optim_state
#16
hanwen-sun
opened
2 months ago
1
Add head commit id in torchacc version
#15
anw90
closed
1 month ago
0
Add torchacc.sync API
#14
anw90
closed
2 months ago
0
Remove model move to support low mem usage in SPMD-FSDP
#13
lausannel
closed
2 months ago
0
Running unit tests when issuing a PR
#12
anw90
closed
2 months ago
0
Add benchmarks folder in code format workflow
#11
anw90
closed
2 months ago
0
Skip flash attention ut for dim > 192 if not using A100/A800 or H100/H800
#10
anw90
closed
2 months ago
0
Create build_image.yml
#9
anw90
closed
2 months ago
0
Add workflow for image building
#8
anw90
closed
2 months ago
0
Support mark dynamic
#7
yitongh
closed
44 minutes ago
0
move .gitignore and .style.yapf to root dir
#6
yitongh
closed
3 months ago
0
Support FlashAttention in SPMD
#5
lausannel
closed
3 months ago
0
Add torchacc/dist folder
#4
anw90
closed
3 months ago
0
Update config.ini for image building
#3
anw90
closed
3 months ago
0
Add docs/.readthedocs.yaml to generate docs on readthedocs.io
#2
anw90
closed
3 months ago
0
Add format checking workflow
#1
anw90
closed
3 months ago
1