unknown word database mangles entities

[unhammer]

sqlite3 -header /home/apy/apertium-apy/missing.db <<EOF
.mode insert
select * from missingFreqs;
EOF

gives me e.g.

INSERT INTO table(pair,token,frequency) VALUES('sme-nob','redakt&oslash',24);
INSERT INTO table(pair,token,frequency) VALUES('sme-nob','Nollii&raquo',3);

– whenever we see an html-entity, it's cut off at the ; so we don't know what the rest of the word is.