volcengine veScale issues

volcengine / veScale

A PyTorch Native LLM Training Framework

http://vescale.xyz

Apache License 2.0

497 stars 19 forks source link

issues

Newest

Newest Most commented Recently updated Oldest Least commented Least recently updated

[QUESTION] questions about Collective Communication Group Initialization Optimization in the paper

#40 siddharthaOnRoad opened 3 weeks ago
0
[RFC] veScale: High-Level API for nD Parallel Training

#39 leonardo0lyj opened 1 month ago
0
[checkpoint] feat: open source fast checkpoint system

#38 MingjiHan99 closed 1 month ago
2
[QUESTION] how and where to use multi-node trace profiler in paper of megascale

#37 oliverYoung2001 opened 1 month ago
1
[Example] Add comments to example codes

#36 lichen225 closed 1 month ago
0
[DTensor&DModule&DDP&Examples] feature updates and new examples

#35 lichen225 closed 1 month ago
0
[docs] fix: update README

#34 leonardo0lyj closed 2 months ago
0
DeviceMesh initialization fix and VeDeviceMesh 2.0

#33 MackZackA closed 2 months ago
1
added veDeviceMesh

#32 MackZackA closed 2 months ago
0
[PyTorch] Add patches for distributed randomness

#29 lichen225 closed 2 months ago
1
[QUESTION]`vescale.dtensor` vs "PyTorch DTensor"

#28 GHGmc2 closed 3 months ago
3
[checkpoint] Open Source

#27 MingjiHan99 closed 3 months ago
3
[QUESTION] Save checkpoint

#26 Ryanuppp closed 3 months ago
1
[Example] add an example of running open Mixtral 8x7B in 4D using veScale

#24 Vremold closed 3 months ago
0
[DTensor]: remove sharding_spec.py

#23 MingjiHan99 closed 3 months ago
0
[Example] add an example of running open llama model in 4D using veScale

#22 jc-bytedance closed 3 months ago
0
[Docker] Add patches for one-hot, expand_as, and etc ops

#21 jc-bytedance closed 3 months ago
0
[DTensor & DModule & DOptim] feature updates

#20 jc-bytedance closed 3 months ago
0
[CI] Add a basic ci test

#19 jc-bytedance closed 3 months ago
0
[Docker] add image-building workflow and update docker file

#18 jc-bytedance closed 3 months ago
0
[QUESTION] will the patch code merged into upstream?

#17 ultranity closed 3 months ago
2
[Example] add an example of finetuning nanoGPT in 4D using veScale

#16 lichen225 closed 3 months ago
0
[Doptim] refine APIs and add more checks for use_distributed_optimizer settings

#15 Vremold closed 3 months ago
0
Code Example & Docs

#14 ultranity closed 3 months ago
2
[Test] fix the test script and some minor bugs in Python unit tests

#13 jc-bytedance closed 3 months ago
0
[DDP&DOptimizer] Open Source

#12 Vremold closed 3 months ago
0
add link to megascale paper

#11 Meteorix closed 4 months ago
0
[DModule] Open Source

#10 leonardo0lyj closed 4 months ago
0
[doc] Rename contribution doc again

#9 liwenchangbdbz closed 4 months ago
0
[DTensor] Open Source

#8 leonardo0lyj closed 4 months ago
1
Add open source schedule

#7 pengyanghua closed 4 months ago
0
[github] update issue templates

#6 liwenchangbdbz closed 4 months ago
0
[doc] change contributors.md to contributing.md

#5 liwenchangbdbz closed 4 months ago
0
[doc] add license in readme

#4 liwenchangbdbz closed 4 months ago
0
fix the typo of project name

#3 pengyanghua closed 4 months ago
0
[doc] add license and contributors md

#2 liwenchangbdbz closed 4 months ago
0
change v

#1 liwenchangbdbz closed 4 months ago
0