volcengine / veScale

A PyTorch Native LLM Training Framework
http://vescale.xyz
Apache License 2.0
553 stars 26 forks source link

[QUESTION]`vescale.dtensor` vs "PyTorch DTensor" #28

Closed GHGmc2 closed 4 months ago

GHGmc2 commented 4 months ago

Thanks for the work.

May I know what's the difference between vescale.dtensor and DTensor in torch?

Thanks!

liwenchangbdbz commented 4 months ago

https://github.com/volcengine/veScale/pull/8 explained the difference.

GHGmc2 commented 4 months ago

8 explained the difference.

Thanks for the info.

leonardo0lyj commented 4 months ago

https://github.com/volcengine/veScale/tree/main/python/vescale/dtensor#what-is-vescale-dtensor