search

mit-nlp / MITIE

MITIE: library and tools for information extraction
2.93k stars 538 forks source link

MITIE Training fails to generate entity_extrator.dat for more examples #188

Open vicky88377 opened 6 years ago

vicky88377 commented 6 years ago

We are using Windows 10 PRO 64 Bit, with RASA .13.0 and Mitie .5.0 version. My RAM is 16GB and Processor : CPU 2.30Ghz, PageFile says: 25677MB used, 938 available.

I'm running MITIE with 180 examples with 24 threads ,It took 4.5 hours and throw exception. [ I have uploaded the exception message what i get.] mitie_issue

mitie.py,line 271, in save_disk if(_f.mitie_save_named_entity_extractor_pure_model(filename, self._obj)!=0): OSError: exception: access viloation reading 0x00000000000..0000030

Also my model_20180918-150254 contains only training_data.json, other files like entity_extractor.dat,intent_classifier.dat, metadata.json,regex_feaurizer.json are not generated.

But when i test the same with only 2-3 examples, it's all good.

davisking commented 6 years ago

If you are hitting the page file then you need more ram. Also make sure you compiled with compiler optimizations enabled and against the intel mkl. That makes it faster.

I don’t know why you get that file error, but it doesn’t have anything to do with MITIE. You need to ask in a rasa nlu form. I don’t know anything about rasa nlu except that it’s apparently hard to use since it’s users frequently post questions about it in MITIE forms.

bofengshuimen77 commented 5 years ago

Do you solve this problem now? I met it too

chongtwo commented 4 years ago

I met it too and don't know how to solve it.