Closed rjagerman closed 9 years ago
This is the first outline on how to do this:
run
method. This method starts an (empty) actor systemActorRef
references to the remote parameter servers which can then be used in any way by the user's code (e.g. to "pull" and "push" model slices)After some consideration this is the current implementation:
Master.run
)Server.run
)new Client(config)
). This client provides an entry point to the master server and is serializable.glint.models.BigModel
. The first implementation using a basic Array as a data structure is implemented in glint.models.array.ArrayBigModel
.ArrayBigModel.create[T](...)
to create a large distributed array of type T. ArrayBigModel
object is then used to access the data without the user's knowledge about the physical location of the parameters. One can use the pull
and push
methods to respectively get and set the parameters.Closing this issue since the basic functionality through a stand-alone deployment is effectively done.
The parameter server will need to be started on certain machines in a cluster. The first step is to get an Akka listener working on machines and provide some form of stand-alone and easy deployment.