Closed nmatthews-asapp closed 6 years ago
I think you ran out of disk space. The problem is exception unwinding is causing a destructor check to fire so it hides the real exception. I've changed the code to not abort so you can see the real error message.
thanks I'll reinstall from master and try again.
this is surprising though, as my machine has about 114 GiB memory free at time of running. in step 2 the estimated memory footprint was < 100 GB and this repo suggests 20-40 GB memory footprint as expected
disk != memory
Whoops I misread your message. Ok, that could be it. I might not have installed it on the right disk (right = the bigger one)
@kpu confirmed: it was lack of disk space. thanks for fixing error exception reporting.
got it working!
When running on the 1b.txt file I get the following error
Specifically this "last input should have been poison message" seems to be the problem. Not sure if it's caused by 1b.txt or another problem yet, but I haven't found any troubleshooting info on KenLM's site related to this issue.
A related issue: https://github.com/kpu/kenlm/issues/177 although it happens on step 4, with a slightly different command