Excessive memory for hfst-compose-intersect

apertium / apertium-ckt

Apertium linguistic data for Chukot

GNU General Public License v3.0

0 stars 0 forks source link

Excessive memory for hfst-compose-intersect #1

Open TinoDidriksen opened 4 years ago

TinoDidriksen commented 4 years ago

These steps reached 18 GB RAM each, before I gave up and killed the build: hfst-compose-intersect -1 .deps/ckt.LR.lexc-twoc.hfst -2 .deps/ckt.twol.hfst -o .deps/ckt.LR.seg.hfst hfst-compose-intersect -1 .deps/ckt.RL.lexc-twoc.hfst -2 .deps/ckt.twol.hfst -o .deps/ckt.RL.seg.hfst

ftyers commented 4 years ago

Yeah, we basically need to merge in Vasya's code from https://github.com/BasilisAndr/chkchn