RasaHQ / rasa

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
https://rasa.com/docs/rasa/
Apache License 2.0
18.88k stars 4.63k forks source link

Discrepency in online training response and agent when deployed. #2364

Closed utkarshrai2 closed 5 years ago

utkarshrai2 commented 6 years ago
**Rasa Core version**: 0.9.8 **Python version**: python3.6 **Operating system** (windows, osx, ...): Linux ubuntu 16.04 LTS **Issue**: When i train by bot using rasa's online feature it gives correct responses. But when i copy the stories in my stories.md file and train a new model the reply given bot is different. **Content of domain file** (if used & relevant): ```yaml ```
utkarshrai2 commented 6 years ago

For example: senario1) If user's intent is login_issue, i ask for email address and then follow some bussiness logic. senario2) if user input email address without bot asking about it, there is a default uttrence. When i train the bot on online trainer it works perfectly. But when i deploy it based on model trained from the generated stroies of online trainer it always give default answer whenever email address in input by user thereby breaking senario1.

akelad commented 6 years ago

Can you post your stories file please? It could be that you have a conflicting story in there from before online training.

utkarshrai2 commented 6 years ago
## happy path
* greet
  - utter_greet

## say goodbye
* goodbye
  - utter_goodbye

## terminology answer
* terminology_info_query
  - terminology_reply

## apply terminology
* apply_query
 - apply_action

## schemes
* scheme_query
 - utter_scheme

## eligibility
* eligibility_query
 - eligibility_action

## fund
* funding_query
 - fund_action

## news
* news_query
 - utter_news

## event
* event_query
 - utter_event

## event
* notice_query
 - utter_notice

## tender_query
* tender_query
 - utter_tender

## incubation period query
* incubation_period_query
 - utter_incubation_period

## location
* location_query
 - utter_location

## contact
* contact_query
 - utter_contact

## listing
* terminology_listing
 - listing_action

## login problem
* login_issue
 - ask_email_action
* email_request
 - check_email_action

## register problem
* register_issue
 - ask_email_action
* email_request
 - check_email_action

## undelved
* email_request
 - invalid_email

## Generated Story -4086056582187086205
* greet
    - utter_greet
* login_issue
    - ask_email_action
* email_request{"emailz": "chs@bjchds.com"}
    - slot{"emailz": "chs@bjchds.com"}
    - check_email_action

## Generated Story -8980599073032025848
* greet
    - utter_greet
* email_request{"emailz": "sdhjidch@asxbsju.com"}
    - slot{"emailz": "sdhjidch@asxbsju.com"}
    - invalid_email
* login_issue
    - ask_email_action
* email_request{"emailz": "sdjkdbc@asghxjs.com"}
    - slot{"emailz": "sdjkdbc@asghxjs.com"}
    - check_email_action

## Generated Story -8436980658183579906
* email_request{"emailz": "cbvdy@ajx.com"}
    - slot{"emailz": "cbvdy@ajx.com"}
    - invalid_email
* login_issue
    - ask_email_action
* email_request{"emailz": "csk@hsicd.com"}
    - slot{"emailz": "csk@hsicd.com"}
    - check_email_action
* terminology_info_query{"terminology": "startup"}
    - slot{"terminology": "startup"}
    - terminology_reply
* location_query{"terminology": "msins"}
    - slot{"terminology": "msins"}
    - export

## Generated Story 432732110256456292
* login_issue
    - ask_email_action
* email_request{"emailz": "dbcj@abdcjh.com"}
    - slot{"emailz": "dbcj@abdcjh.com"}
    - check_email_action
* terminology_info_query{"terminology": "coma"}
    - slot{"terminology": "coma"}
    - terminology_reply
* login_issue
    - ask_email_action
* email_request{"emailz": "cishci@ahdi.com"}
    - slot{"emailz": "cishci@ahdi.com"}
    - check_email_action
* email_request{"emailz": "cbjdsb@hdchjikw.com"}
    - slot{"emailz": "cbjdsb@hdchjikw.com"}
    - invalid_email
* login_issue
    - ask_email_action
* email_request{"emailz": "cnsikd@askhcis.com"}
    - slot{"emailz": "cnsikd@askhcis.com"}
    - check_email_action
* login_issue
    - ask_email_action
* email_request{"emailz": "dcnks@ahscj.com"}
    - slot{"emailz": "dcnks@ahscj.com"}
    - check_email_action
* email_request{"emailz": "vndjk@ncjsd.com"}
    - slot{"emailz": "vndjk@ncjsd.com"}
    - invalid_email
* greet
    - utter_greet
* terminology_info_query{"terminology": "csjk"}
    - slot{"terminology": "csjk"}
    - utter_greet
* email_request{"emailz": "cksdnck@skjcnijkd.com"}
    - slot{"emailz": "cksdnck@skjcnijkd.com"}
    - invalid_email
* login_issue
    - ask_email_action
* email_request{"emailz": "cnsjk@skhck.com"}
    - slot{"emailz": "cnsjk@skhck.com"}
    - check_email_action
* terminology_info_query{"terminology": "nestle"}
    - slot{"terminology": "nestle"}
    - export

## Generated Story 6689116447163821223
* login_issue
    - ask_email_action
* email_request{"emailz": "bj@KDJCNK.COM"}
    - slot{"emailz": "bj@KDJCNK.COM"}
    - check_email_action
* login_issue
    - ask_email_action
* email_request{"emailz": "cjhdwhbc@xjhw.com"}
    - slot{"emailz": "cjhdwhbc@xjhw.com"}
    - check_email_action
* email_request{"emailz": "sxkjwnx@xbjw.com"}
    - slot{"emailz": "sxkjwnx@xbjw.com"}
    - invalid_email
* greet
    - utter_greet
* funding_query
    - export

## Generated Story 8433778642108197057
* greet
    - utter_greet
* login_issue
    - ask_email_action
* email_request{"emailz": "cbjds@hxska.com"}
    - slot{"emailz": "cbjds@hxska.com"}
    - check_email_action
* email_request{"emailz": "bcjhb@chjsdc.com"}
    - slot{"emailz": "bcjhb@chjsdc.com"}
    - invalid_email
* funding_query
    - export

## Generated Story -4288111952705643768
* login_issue
    - ask_email_action
* email_request{"emailz": "csdjh@xgjha.com"}
    - slot{"emailz": "csdjh@xgjha.com"}
    - check_email_action
* email_request{"emailz": "cdjhsc@xxhkjds.com"}
    - slot{"emailz": "cdjhsc@xxhkjds.com"}
    - invalid_email
* greet
    - utter_greet
* funding_query
    - export

## Generated Story 5328177555386373798
* login_issue
    - ask_email_action
* email_request{"emailz": "cnsdjb@jsdcbjh.com"}
    - slot{"emailz": "cnsdjb@jsdcbjh.com"}
    - check_email_action
* login_issue
    - ask_email_action
* email_request{"emailz": "sdnjiv@aghcxjw.com"}
    - slot{"emailz": "sdnjiv@aghcxjw.com"}
    - check_email_action
* login_issue
    - ask_email_action
* email_request{"emailz": "snbj@cbkjsdc.com"}
    - slot{"emailz": "snbj@cbkjsdc.com"}
    - check_email_action
* login_issue
    - ask_email_action
* funding_query
    - utter_fallback
* funding_query
    - export
utkarshrai2 commented 6 years ago

Sorry for the bother my issue is resolved... thanx for prompt response.