search

mindspore-lab / mindone

one for all, Optimal generator with No Exception
https://mindspore-lab.github.io/mindone/
Apache License 2.0
337 stars 63 forks source link

Support optimizer parallel training for SDXL #313

Open Gaohan123 opened 5 months ago

Gaohan123 commented 5 months ago

Can we use a clearer terminology here? It's not clear what Zero3 means.

Here it means the parallel algorithm is ZeRO3. It is definitely hard to clarify in a short name. This one is already after discussion.

hadipash commented 5 months ago

Can we use a clearer terminology here? It's not clear what Zero3 means.

Here it means the parallel algorithm is ZeRO3. It is definitely hard to clarify in a short name. This one is already after discussion.

I see, then can preserve the capitalization and spell ZeRO3 so others can understand that it's an acronym.