uscensusbureau / fismatic

https://github.com/uscensusbureau/fismatic/projects/1
Other
11 stars 10 forks source link

parallelize SSP processing #46

Open afeld opened 5 years ago

afeld commented 5 years ago

Tried this using multiprocessing.Pool and it was much slower, presumably because the model needed to be loaded in each subprocess. Worth trying the other built-in options before going to something fancier like Apache Spark.