Open afeld opened 5 years ago
Tried this using multiprocessing.Pool and it was much slower, presumably because the model needed to be loaded in each subprocess. Worth trying the other built-in options before going to something fancier like Apache Spark.
multiprocessing.Pool
Tried this using
multiprocessing.Pool
and it was much slower, presumably because the model needed to be loaded in each subprocess. Worth trying the other built-in options before going to something fancier like Apache Spark.