search

facebookresearch / TensorComprehensions

A domain specific language to express machine learning workloads.
https://facebookresearch.github.io/TensorComprehensions/
Apache License 2.0
1.76k stars 211 forks source link

MPI suppot #175

Open abidmalikwaterloo opened 6 years ago

abidmalikwaterloo commented 6 years ago

I apologize if this question is not relevant to this forum. Does this framework support MPI?

Thanks,

ftynse commented 6 years ago

Not at the moment. TC targets a single device (GPU, CPU) and does not manage communication nor allocation. This may change in the future.

TC is not a framework. It may be integrated into ML frameworks, like PyTorch or Caffe2.

prigoyal commented 6 years ago

I believe @nicolasvasilache would have something to add ;)

abidmalikwaterloo commented 6 years ago

Thanks for the feedback.

Can this be integrated with Tensorflow? I quickly went through the paper "Tensor Comprehension: Framework - Agnostic High Performance Machine Learning Abstractions". It didn't talk about TF much. Maybe I missed something. Also, Can it be used with OpenMP programming models etc?

On Mon, Mar 19, 2018 at 2:19 PM, Priya Goyal notifications@github.com wrote:

I believe @nicolasvasilache https://github.com/nicolasvasilache would have something to add ;)

— You are receiving this because you authored the thread. Reply to this email directly, view it on GitHub https://github.com/facebookresearch/TensorComprehensions/issues/175#issuecomment-374314401, or mute the thread https://github.com/notifications/unsubscribe-auth/AAbSUEsImAGUffdjOBRcFXCFwCGwUTc8ks5tf_aggaJpZM4Swkrc .

-- Abid M. Malik

"I have learned silence from the talkative, toleration from the intolerant, and kindness from the unkind"---Gibran "Success is not for the chosen few, but for the few who choose" --- John Maxwell "Being a good person does not depend on your religion or status in life, your race or skin color, political views or culture. IT DEPENDS ON HOW GOOD YOU TREAT OTHERS"--- Abid "The Universe is talking to us, and the language of the Universe is mathematics."----Abid

ftynse commented 6 years ago

Can this be integrated with Tensorflow?

Yes, it can be integrated. We will be happy to provide assistance in that, but you'd have to contact Tensorflow developers and ask them to integrate TC.

Also, Can it be used with OpenMP programming models.

Yes, it should be possible to emit OpenMP or other parallel code for CPU. This backend is still in progress (and will probably not use OpenMP but a parallel version of the LLVM IR called Tapir). Stay tuned for the release.