search

amir-zeldes / HebPipe

An NLP pipeline for Hebrew
Other
34 stars 9 forks source link

lemmas origin #44

Closed roeycohen closed 8 months ago

roeycohen commented 11 months ago

Hi @amir-zeldes, thanks for this great repository.

Just wondering, where did you get the full lemmas list of data/heb.lex?

Thanks, Roey

amir-zeldes commented 10 months ago

Hi Roey - they were initially derived from the MILA center full form lexicon, as described in the paper, but there have been some expansions, and we now have substantially more manually lemmatized/corrected data in the newer IAHLT corpora as well.