probcomp / cgpm

Library of composable generative population models which serve as the modeling and inference backend of BayesDB.
Apache License 2.0
25 stars 11 forks source link

Implement multiprocessed dependence probability pairwise #222

Closed fsaad closed 7 years ago

fsaad commented 7 years ago

For large number of variables, it is more efficient to compute the dependence matrix separately for each state in a worker process and aggregate the results in the engine. Note that bayeslite will not be able to use this optimisation since sqlite does not support bulk pairwise, but the API should still provide such an implementation for non-bayeslite workflows.