OpenBMB / CPM-Live

Live Training for Open-source Big Models
511 stars 40 forks source link
deep-learning multi-task-learning natural-language-generation natural-language-processing natural-language-understanding nlp parameter-efficient-learning pretrained-language-model

CPM-Live

**Live Training for Open-source Big Models**

WebsitePlanDiscussion简体中文

What's New

Milestones

Training Plan

Considering the scale of data and computing resources, CPM-Live will start with a 10B model training.

During training we will do:

During training you can:

Community

Our community is based on GitHub Discussions.

Read the first post and start your exploration on CPM-Live!