make lt-comp go a bit faster

apertium / lttoolbox

Finite state compiler, processor and helper tools used by apertium

http://wiki.apertium.org/wiki/Lttoolbox

GNU General Public License v2.0

18 stars 22 forks source link

make lt-comp go a bit faster #114

Closed mr-martian closed 3 years ago

mr-martian commented 3 years ago

Compiling the cat monodix was taking about 15 seconds that seemed kind of high to me so I implemented the changes mentioned in #96 and also poked at some other things and managed to get the cat compile time down to about 12.5 seconds.

From profiling it looks like 80% of the runtime of lt-comp is in transducer.minimize() which is inconveniently also the the one step of the process that I don't actually understand.

unhammer commented 3 years ago

LGTM

mr-martian commented 3 years ago

The efficiency tweaks have now been incorporated into #115, so I'm closing this since the #96 piece probably needs more discussion and merging vs redoing are likely to be of comparable effort.