search

intel-analytics / BigDL-Tutorials

Step-by-step Deep Leaning Tutorials on Apache Spark using BigDL
208 stars 123 forks source link

does bigDL supports Asynchronous SGD and Synchronous SGD ? if supports please send reference link or Use case.. #64

Closed orsushiva closed 4 years ago

orsushiva commented 4 years ago

I want to achieve Parallel SGD on a Distributed environment on (YARN cluster).

jason-dai commented 4 years ago

BigDL provides data-parallel synchronous SGD; you may refer to the paper https://arxiv.org/abs/1804.05839 for more technical details.