So far I understand that "language model is trained with the stream of text". That means there is no grammatical boundary of sentence start and end (i.e., full stop (.), exclam mark (!)). I was wondering if there are any noise-induced by this.
So my question is if I train a language model with/without sentence boundary may I expect to see any difference
So far I understand that "language model is trained with the stream of text". That means there is no grammatical boundary of sentence start and end (i.e., full stop (.), exclam mark (!)). I was wondering if there are any noise-induced by this.
So my question is if I train a language model with/without sentence boundary may I expect to see any difference
@glample @aconneau