Use Akka TCP streaming for the data instead of messages

rjagerman / glint

Glint: High performance scala parameter server

MIT License

168 stars 62 forks source link

Use Akka TCP streaming for the data instead of messages #8

Closed rjagerman closed 8 years ago

rjagerman commented 9 years ago

Currently data is send as an Array of keys/values in a basic Akka message. For best performance it is worthwhile to investigate low level Akka TCP streams.

rjagerman commented 8 years ago

This doesn't seem necessary at the moment since message performance (especially with the new specialized serializers) is already quite good.