Fix endoding issues - Githubissues

RasaHQ / rasa

💬 Open source machine learning framework to automate text- and voice-based conversations: NLU, dialogue management, connect to Slack, Facebook, and more - Create chatbots and voice assistants

https://rasa.com/docs/rasa/

Apache License 2.0

18.61k stars 4.6k forks source link

Fix endoding issues #13041

Open jzaprzalka opened 2 months ago

jzaprzalka commented 2 months ago

Fixes encoding issues referenced in issue OSS-781 while running rasa data split nlu with entities containing non-english characters

Proposed changes:

Add ensure_ascii=False for json.dumps in TrainingDataWriter in order to properly encode non-ascii chatacters, e.g. Polish letters as referenced in issue OSS-781

Status (please check what you already did):

[ ] added some tests for the functionality
[ ] updated the documentation
[ ] updated the changelog (please check changelog for instructions)
[ ] reformat files using black (please check Readme for instructions)

CLAassistant commented 2 months ago

All committers have signed the CLA.