search

rodrigopivi / Chatito

🎯🗯 Dataset generation for AI chatbots, NLP tasks, named entity recognition or text classification models using a simple DSL!
https://rodrigopivi.github.io/Chatito/
MIT License
876 stars 157 forks source link

Chatito npm script generates training/testing data only from last processed .chatito file #31

Closed heaven00 closed 6 years ago

heaven00 commented 6 years ago

I have a list of .chatito files in the folder and I am using the following command

npx folder/path --format rasa --outputPath data/nlu

it prints 

Processing file: /folder/path/bye.chatito
Processing file: /folder/path/greet.chatito
Processing file: /folder/path/negative.chatito
Saved training dataset: ./rasa_dataset_training.json
Saved testing dataset: ./rasa_dataset_training.json

But the training set and test set only contains sample from negative.chatito, the last processed file.

rodrigopivi commented 6 years ago

Hi @heaven00,

Thanks for reporting, this was indeed an issue with the rasa adapter and how it deep-merged the datasets, fixed with release 2.1.4

Again thanks for reporting, let me know if you have more issues, closing the issue for now.