search

hpcaitech / ColossalAI-Examples

Examples of training models with hybrid parallelism using ColossalAI
Apache License 2.0
334 stars 102 forks source link

Feature/bert #52

Closed Wesley-Jzy closed 2 years ago

Wesley-Jzy commented 2 years ago

BERT Example: Add Mask LM & Next Sentence Prediction Label for Wikitext.