daniel-kukiela / nmt-chatbot

NMT Chatbot
GNU General Public License v3.0
387 stars 214 forks source link

Default constantly returning similar responses to questions. #145

Open Directory opened 4 years ago

Directory commented 4 years ago

I know something like this isn't necessarily a bug but this behavior is weird. im using the default everything. the default datasets that came as test data etc. every question i ask it through the inference returns a similar response. "im not sure if your a good thing" Heres a log of some increadably intellectual and pressing questions i asked it.

> how are you doing
- I'm not sure if you're a good thing [-92.25]

> how are you doing
- I'm not sure if you're a good thing [-92.25]

> how are you doing?
- I'm not sure if you're a good thing. [7.8999999999999995]

> what does that mean
- I'm not sure that's [-97.65]

> what does that mean?
- I'm not sure that's what I [-96.6]

> what does that mean?
- I'm not sure that's what I [-96.6]

> elaborate
- I' [-88.2]

> b
- I' [-88.2]

> a
- I' [-88.2]

> e
- I' [-88.2]

> gg
- I'm not [-87.45]

> eeeeeeeeeee
- I'm not sure if [-98.25]

> eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee
- ****************** [15.2]

> eeeeeeeeeeeeeeeeeeeee
- I'm not sure if you' [-97.5]

> eeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeeee
- ****************** [15.2]

> are you a good thing
- I'm not sure if you're a good thing. [7.8999999999999995]

> am i a good thing
- I'm not sure if you're a [-96.9]

> are you dumb?
- I'm not sure if you're a good thing [-92.25]

> thats kinda cringe bro
- I'm not sure if you' [-97.5]

> do you like cats
- I'm not sure if you' [-97.5]

> yo yo bro
- I'm not sure if I' [-97.8]

> who would win in a fight, lebron james, or a gorilla wearing sandals?
- I'm not sure if you're a good idea. [4.75]

Did anybody else get these types of responses using the default datasets? i havnt tweaked any settings or anything. im still very unfamilier with nmt, deep learning etc so a lot of the terminology in the README confused me. took me like a day to even get this far cause tensorflow was difficult to setup right. Honestly i would appriciate any general advice that could help me get pointed in the right direction.

Directory commented 4 years ago

frankly i feel like its subtly dissing me. what a time we live in

89Q12 commented 4 years ago

Get more training data and train longer

kaljitism commented 4 years ago

Increase the training row pairs.

astrickash commented 3 years ago

I trained it in 30 Million pairs for 100k steps and still getting all replies having "I'm not sure if " sentence. What should i do to improve the replies?