To make life easier for beginners looking to experiment with seq2seq model. Read the article I wrote on seq2seq - Practical seq2seq, for more details.
Update
After tweaking the dataset to bring down the overall % of unknown tokens to 3%, increasing vocabulary to 8000, the results are promising.
Query | Reply |
---|---|
donald trump won last nights presidential debate according to snap online polls | thought he was a joke |
trump campaign please never delete this | he was a joke |
s new scoop is unk the castro connection how trumps company violated the us embargo against cuba | trump is a disgrace to the debate and the media is not a liar |
who won the first presidential debate | trump will be a better time for a man |
just wanna live in unk everything is 10x better there | i was just on the same side and i was like it was a good time |
the lil girl i forgot her name scares the shit out of me n probably always will lmaooo | she was so cute and she was so cute and she was a bitch |
question of the day who do you think won last nights debate weigh in using | hillary is a trump supporter and a woman who has a better job than a woman |
trump is a total embarrassment hes like a unk child who happens to be a professional liar and con man | trump is a lot of money to get a great country |
chill the fuck out | thats what i said |
so fun to see what the special effects team created for | wow that is the best thing ive ever seen |
she was fine too unk voice | she is a good guy |
the important ones are still here | i dont think so |
been drinking pumpkin spice protein shake every morning for a week and now i literally cannot even | me too i just got it |
lmao i just lost my job and i cant even leave early to be in the unk video today | literally the same thing |
hey happy birthday have a nice day | thank you |
\~4% unknown tokens in dataset; vocabulary of 8000.
Query | Reply |
---|---|
when are you going to let the police know | you dont know what youre talking about |
you can do it | yeah i think so |
wait are you saying that i dont appreciate | i know you know what i mean |
youre terrible | yeah but im not |
nah i dont think so | why not |
hes pissing in our faces again and were just taking it | i cant |
im sorry i dont know what else to say except im sorry | why would you like to be |
nobodys gonna get you now get inside | i cant go back |
shall i leave | of course |
well i really think hes got a chance | i know |
youd better be quiet sandy | shut up |
jesus christ you scared the shit out of me | whats going on |
well im sorry im really sorry ellie | its okay |
my lady this play will end badly i will tell | lets get out of here |
im going to miss you | no youre not |
what do you mean | i dont know i dont know what i mean |
my god these people are insane | we dont know what they are |
this isnt a date | no what is it |
you ought to go home and take care of that | i cant do that |
is something wrong | no no no |