search

stephbuon / digital-history

Instructional repository for "Text Mining as Historical Method"
GNU General Public License v3.0
7 stars 3 forks source link

Optimize spaCy's nlp.pipe() for M2 #2

Closed stephbuon closed 3 years ago

stephbuon commented 4 years ago

nlp.pipe() in m2_gender.ipynb is very slow. Thus far I have added more threads for processing, but to not much avail.

Rob is looking into additional solutions so that the code can run quicker while still in Jupyter Notebook.