microsoft / CNTK

Microsoft Cognitive Toolkit (CNTK), an open source deep-learning toolkit
https://docs.microsoft.com/cognitive-toolkit/
Other
17.53k stars 4.28k forks source link

CNTK data parallel training #2639

Open mrcabellom opened 7 years ago

mrcabellom commented 7 years ago

Hello,

Can I have two cntk data parallel trainer class in the same python process? Cntk throw an error: "Data parallel learning is a singleton class"

Regards

ke1337 commented 7 years ago

What is your goal? CNTK uses MPI as inter-process communication channel, so two instances of distributed learner would conflict with each other.

mrcabellom commented 7 years ago

Thanks for your response.

My goal is execute two different learners with different models in the same python process, finish a parallel learner scenario and launch other new again.