search

facebookresearch / ParlAI

A framework for training and evaluating AI models on a variety of openly available dialogue datasets.
https://parl.ai
MIT License
10.49k stars 2.1k forks source link

Question about the answer of the model bb3 3b #4986

Closed Vitaliy136 closed 1 year ago

Vitaliy136 commented 1 year ago

I use the bb3 3b model. In general, the model responds very well

Dialogue example:

Human: Tell me your name Bot: [Sorry, could not process that message. Please try again.]

Human: I am John. Tell me your name Bot: Hello, my name is John. How are you doing today? What do you do for a living?

Launch parameters:

parlai safe_interactive --model-file zoo:bb3/bb3_3B/model --init-opt gen/r2c2_bb3 --search_server localhost:8080 --debug --verbose

Why does the bot sometimes answer me with my own words? Perhaps this behavior is influenced by one of the agents, such as the Memory Knowledge agent? Is it possible to change this behavior?

klshuster commented 1 year ago

That is a known issue in dialogue models, see e.g. our study on maintaining character in dialogue.

github-actions[bot] commented 1 year ago

This issue has not had activity in 30 days. Please feel free to reopen if you have more issues. You may apply the "never-stale" tag to prevent this from happening.