-
Hi,
I met a problem when doing lemmatization.
When lemmatizing "**Mary fries some French fries**", the verb "fries" was wrongly lemmatized as "fries", which is the lemma of the noun "fries". Mea…
-
**Is your feature request related to a problem? Please describe.**
For the word models of Finnish parliamentary data, the preprocessing included lemmatization with spaCy's `fi_core_news_lg` model. Re…
-
Talking about word count, it seems we have an issue with the postfix of each word on the list and/or the word count logic. (ie: `peopl`, `technolog`, `imag`, `polic`, etc)
https://incidentdatabase.…
pdcp1 updated
8 months ago
-
The word "using" is lemmatized incorrectly:
```
import pattern.en
print("using", pattern.en.lemma("using"))
print("use", pattern.en.lemma("use"))
```
The result is:
```
using used
use…
-
We should write a summary if this does not already exist, since https://universaldependencies.org/u/overview/morphology.html#lemmas says 'treebanks have considerable leeway in interpreting what “canon…
-
# 英语单词的词形还原(Lemmatization)
## 定义
把单词的各种时态人称单复数的变形转为原形,比如:
- 动词原型 `calls`, `called`, `calling` -> `call`
- 名词单数 `cats` -> cat
- 比较级和最高级 `hardest` -> `hard`
## 可用的库:
pyhton:
- 自然语言工具…
-
Dear authors, thank you for the great keyword extracting methods.
When extracting keywords with YAKE it usually happens that in-between keywords there are two words with the same lemma (e.g. tree,…
-
The following strategies can be used:
- [x] Remove uncommon tags with low number of occurrences (e.g. 1000, but depending on the size of the dataset and domain)
- [ ] Aggregate tags that refer to…
-
first off I am a big fan of your work, thank you so much for your work with global south
my question is on the following
(26)
>>> w1 = hm.anal('a', 'ይሰማሉ')
>>> w1[0]['lemma']
'ሰማ'…
-
It seems that while there is support for tokenization with diacritics in spaCy, the project doesn't lemmatize/morph/pos tag correctly when they are used.
## How to reproduce the behaviour
```
imp…
mtak- updated
6 months ago