search

kristopherkyle / TAALED

Tool for the Automatic Assessment of Lexical Diversity
https://www.linguisticanalysistools.org/taaled.html
10 stars 3 forks source link

Increasing memory allocation #1

Open JerGag opened 3 years ago

JerGag commented 3 years ago

Thank you for this great tool! I am testing a corpus of various sizes to get a sense of its lexical diversity, but I am hit an error message saying that some of the documents I use contain too many words for analysis. I there a way to increase the memory allocation of the program manually?

kristopherkyle commented 3 years ago

Yep. Check this out: https://datascience.stackexchange.com/questions/38745/increasing-spacy-max-nlp-limit/55725

Though you might ask yourself WHY you need lexical diversity values for very long texts...

Best,

Kris

On Wed, Jan 27, 2021 at 7:09 PM JerGag notifications@github.com wrote:

Thank you for this great tool! I am testing a corpus of various sizes to get a sense of its lexical diversity, but I am hit an error message saying that some of the documents I use contain too many words for analysis. I there a way to increase the memory allocation of the program manually?

— You are receiving this because you are subscribed to this thread. Reply to this email directly, view it on GitHub https://github.com/kristopherkyle/TAALED/issues/1, or unsubscribe https://github.com/notifications/unsubscribe-auth/AEW7H3PIWDH2MXYXPPQKDNDS4DIP5ANCNFSM4WWKQVBQ .

-- Kristopher Kyle Assistant Professor Department of Linguistics University of Oregon www.kristopherkyle.com