search

alibaba / Pai-Megatron-Patch

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
Apache License 2.0
723 stars 103 forks source link

optimizer offload #352

Closed leo-ztjht closed 1 month ago

leo-ztjht commented 2 months ago

import megatron_patch 这个megatron_patch 是从哪里来的。运行报错 ModuleNotFoundError: No module named 'megatron_patch'

jerryli1981 commented 1 month ago

您好，应该还是镜像以及softlink，另外megatron patch本身是免安装的