jbrry / Irish-BERT

Repository to store helper scripts for creating an Irish BERT model.
Other
9 stars 0 forks source link

Train a generative model such as GPT-2 #88

Open jbrry opened 3 years ago

jbrry commented 3 years ago

Motivation - for education-related texts (e.g. for primary or secondary school students), it would be good to have a generative model. The model could be used in online games such as Liang Xu's game, who mentioned perhaps we could control the accuracy of the model, to make it more or less difficult for the user.

Update in 2024: Recently, Tran et al. trained causal LLMs for Irish (source: issue #125):