N-gram statistic model

[JianyuZhao7]

Hi, I would like to ask how to implement the bi-directional 3-gram model for the generator. Could you please share the codes or any other material？

Thanks a lot.

Best.

[fengzhangyin]

We simply use a statistics-based language model. We first calculate the tri-gram distribution on the training data and then predict mask words.