search

amplab / velox-modelserver

http://amplab.github.io/velox-modelserver/
Apache License 2.0
110 stars 26 forks source link

Totally redid the models for training & the coordination #44

Closed tomerk closed 9 years ago

tomerk commented 9 years ago

Stripped the entire pluggable KV storage backend system replacing it w/ versioned broadcasting and changed up the model implementation interfaces to lessen the load on model implementers.

Relates to everything but most strongly issue #39

tomerk commented 9 years ago

@dcrankshaw

dcrankshaw commented 9 years ago

Awesome. This looks good to me. Can I assume that it actually works?

tomerk commented 9 years ago

The part of using spark as a filesystem to write to/from HDFS definitely works, and it works end to end w/ a local spark master and a local data directory, so it should be working end to end on a remote spark cluster (unclear how quickly though, there's a sizable delay because of needing to ship the jar)

dcrankshaw commented 9 years ago

Cool. Merged.