PS Lite - Githubissues

ytgui / temp

0 stars 0 forks source link

PS Lite #74

Open ytgui opened 5 years ago

ytgui commented 5 years ago

https://github.com/dmlc/ps-lite https://github.com/bytedance/byteps

ytgui commented 5 years ago

Notes

Train with terabytes or petabytes of data and create models out of it.
Parameters need to be shared and then updated across multiple nodes.
Sharing is expensive in terms of bandwidth.