Multirandom forest parallelism

GeoscienceAustralia / uncover-ml

Machine Learning system for Geoscience Australia uncover project

Apache License 2.0

30 stars 20 forks source link

Multirandom forest parallelism #72

Closed brenmous closed 4 years ago

brenmous commented 4 years ago

Need to investigate how multirandomforest works in parallel. It's currently unknown whether or not it's parallelised.

brenmous commented 4 years ago

Training and cross validation are parallelised but prediction doesn't appear to be. Will look at implementing and testing in future.

brenmous commented 4 years ago

Prediction is run in parallel - image data is split across nodes. Fixed a bug where random seed was tied to processor rank. This meant that MRF results would vary based on the number of processors being used.