search

PaddlePaddle / PaddleMIX

Paddle Multimodal Integration and eXploration, supporting mainstream multi-modal tasks, including end-to-end large-scale multi-modal pretrain models and diffusion model toolbox. Equipped with high performance and flexibility.
Apache License 2.0
301 stars 117 forks source link

并行训练 #618

Closed yimuu closed 2 months ago

yimuu commented 2 months ago

设置了并行训练参数，但还是只有1块显卡被使用 "sharding": "stage2", "tensor_parallel_degree": 2, "sharding_parallel_degree": 8,

jerrywgz commented 2 months ago

可以发下具体的启动命令

yimuu commented 2 months ago

已经解决了，谢谢😂