search

bnosac / udpipe

R package for Tokenization, Parts of Speech Tagging, Lemmatization and Dependency Parsing Based on the UDPipe Natural Language Processing Toolkit
https://bnosac.github.io/udpipe/en
Mozilla Public License 2.0
209 stars 33 forks source link

Parallel Processing #74

Closed snvv closed 4 years ago

snvv commented 4 years ago

Hello udpipe utilizes multithreaded CPU’s but udpipe_annotate and txt_sentiment uses only a single core. Is it possible to run all functions using parallel processing? Thank you Sotiris

jwijffels commented 4 years ago

Sure that is possible. You can use a similar setup as shown in the section on future.apply at the pkg vugnette https://cran.r-project.org/web/packages/udpipe/vignettes/udpipe-parallel.html Just write your own FUN and use inside that function whichever calls you like to use.