[QUESTION]`vescale.dtensor` vs "PyTorch DTensor"

volcengine / veScale

A PyTorch Native LLM Training Framework

http://vescale.xyz

Apache License 2.0

662 stars 34 forks source link

Closed GHGmc2 closed 7 months ago

GHGmc2 commented 7 months ago

Thanks for the work.

May I know what's the difference between vescale.dtensor and DTensor in torch?

Thanks!

liwenchangbdbz commented 7 months ago

GHGmc2 commented 7 months ago

8 explained the difference.

Thanks for the info.

leonardo0lyj commented 7 months ago