search

amplab / velox-modelserver

http://amplab.github.io/velox-modelserver/
Apache License 2.0
110 stars 26 forks source link

Tachyon Support #8

Closed dcrankshaw closed 9 years ago

dcrankshaw commented 9 years ago

Velox needs some additional support from Tachyon that doesn't exist right now. While the code to address the issue will be in the Tachyon repo, this issue can be used to track it. @haoyuan should I file a Tachyon JIRA issue for this as well?

Tachyon's KV store interface only supports range-partitioned, immutable partitions. Velox needs hash-partitioned, mutable partitions so that we can update user models and write additional training data as we perform online updates to the user models.

haoyuan commented 9 years ago

@dcrankshaw Yes, it will be great to file two JIRA issues (hash-partitioned, mutable partitions) there: https://tachyon.atlassian.net/browse/TACHYON/

dcrankshaw commented 9 years ago

This is not mission critical to Velox right now. We can still use Tachyon as a faster version of HDFS, and for now Velox will limit its use of Tachyon to existing functionality.