alibaba / Pai-Megatron-Patch

The official repo of Pai-Megatron-Patch for LLM & VLM large scale training developed by Alibaba Cloud.
Apache License 2.0
723 stars 103 forks source link

fix: qwen1.5 run_pretrain_megatron_qwen.sh tokenizer error #336

Closed village-way closed 2 months ago

village-way commented 2 months ago

image

CLAassistant commented 2 months ago

CLA assistant check
All committers have signed the CLA.