ku-nlp / jumanpp

Juman++ (a Morphological Analyzer Toolkit)
https://nlp.ist.i.kyoto-u.ac.jp/index.php?JUMAN%2B%2B
Apache License 2.0
376 stars 45 forks source link

Trim saved models after writing their content #139

Open eiennohito opened 3 years ago

eiennohito commented 3 years ago

Right now we simply mmap files and write to them. If the file was larger originally, it will keep its size, wasting space.

Also we should update timestamps on model files.