Open BernierCR opened 5 years ago
What I meant in the last apostrophe thread. It won't let me post there anymore, maybe because it's closed issue?
What i mean is text like this "Bob tried to talk to Alice, but she didn 't like any of his messages"
Then this tokenizes to "didn t" Instead of "didnt", or better "did not".
The extra space before an apostrophe is so common, they include it on some job interviews!
Thanks
What I meant in the last apostrophe thread. It won't let me post there anymore, maybe because it's closed issue?
What i mean is text like this "Bob tried to talk to Alice, but she didn 't like any of his messages"
Then this tokenizes to "didn t" Instead of "didnt", or better "did not".
The extra space before an apostrophe is so common, they include it on some job interviews!
Thanks