Get Ngrams frequencies fix

yooper / php-text-analysis

PHP Text Analysis is a library for performing Information Retrieval (IR) and Natural Language Processing (NLP) tasks using the PHP language

https://github.com/yooper/php-text-analysis/wiki

MIT License

527 stars 87 forks source link

Get Ngrams frequencies fix #49

Closed Euak closed 5 years ago

Euak commented 5 years ago

Hello @yooper I found out that the previous method to get the frequencies of the tokens in a ngram array was performing too badly in large texts. I changed the method and now is running way better now.