search

bobye / d2_kmeans

Fast discrete distributions clustering using Wasserstein barycenter with sparse support
Other
12 stars 3 forks source link

pthreads or MPI? #6

Closed bobye closed 9 years ago

bobye commented 9 years ago

It seems for shared mem computer, pthreads lib can be a simple candidate to an MPI lib. Is there any particular reason that we have to use MPI instead of pthreads?

@robbwu

robbwu commented 9 years ago

You can use either MPI or pthreads on shared memory system. However, you are going to have to use MPI for distributed memory system anyway, it might be easier to just use MPI at first, for both distributed and shared memory. Later on if for performance reason we can optimize the inter-node part in pthreads/OpenMP etc.

Besides, message passing can be easier to develop/debug than memory sharing.

On Tue, Jan 6, 2015 at 7:43 AM, Jianbo Ye notifications@github.com wrote:

It seems for shared mem computer, pthreads lib can be a simple candidate to an MPI lib. Is there any particular reason that we have to use MPI instead of pthreads?

@robbwu https://github.com/robbwu

— Reply to this email directly or view it on GitHub https://github.com/bobye/d2_clustering/issues/6.

bobye commented 9 years ago

some notes on OpenMP

Under Linux

Under Mac OS Mavericks