kpu / kenlm

KenLM: Faster and Smaller Language Model Queries
http://kheafield.com/code/kenlm/
Other
2.5k stars 513 forks source link

covert .arps to .klm error #353

Closed Deep-sea-boy closed 3 years ago

Deep-sea-boy commented 3 years ago
image

help!!!!!!!

Deep-sea-boy commented 3 years ago

I have tried the small file of 200M is ok. Is it possible that the conversion fails because the file is too large

Deep-sea-boy commented 3 years ago

myfile: pdf_content_text:22G > pdf_arps:4.7G > (error_build for .klm)

kpu commented 3 years ago

You ran out of RAM. Get more RAM or read https://kheafield.com/code/kenlm/structures/