search

RasaHQ / rasa

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants
https://rasa.com/docs/rasa/
Apache License 2.0
18.92k stars 4.63k forks source link

Scheduled Model Regression Test Failed #10041

Closed rasabot closed 3 years ago

rasabot commented 3 years ago

This PR is automatically created by the Scheduled Model Regression Test workflow. Checkout the Github Action Run here.
---
Description of Problem:
Scheduled Model Regression Test failed.
Configuration: Rules + AugMemo
Dataset: retail-demo

tttthomasssss commented 3 years ago

Affected datasets:

tttthomasssss commented 3 years ago

Currently the new domain.yml file is not compatible with rasa<3.0 (see Melinda's comment here). That means that we need to run the scheduled model regression tests from a different branch for insurance-demo, financial-demo, retail-demo and helpdesk-assistant until rasa 3.0 is out.

Specifying a different branch for the scheduled test for a single dataset from the training-data repo is slightly more involved (see Slack thread).

Given the situation with the incompatible domain file is only temporary (until Rasa 3.0 is out), and that the last remaining dataset affected by the change is Sara from the training-data repository, the simplest solution is to have the old and new domain file in the Sara dataset and to remove the old version once Rasa 3.0 is released.

tttthomasssss commented 3 years ago

fixed with test runs #10085 and #10088