search

syndicate-storage / syndicate

Internet-scale software-defined storage system
Apache License 2.0
56 stars 10 forks source link

UG cache maintenance #47

Closed jcnelson closed 10 years ago

jcnelson commented 10 years ago

The UG should keep track of which blocks are locally cached, and expose this information to applications (via xattr or similar). This is so JSyndicateFS can let Hadoop schedule jobs on VMs that locally host cached data.

jcnelson commented 10 years ago

To continue using Squid for caching, have the UG send ICP requests to it to see if data is cached or not. See https://tools.ietf.org/html/rfc2186 for the packet formatting.

jcnelson commented 10 years ago

Alternatively, we can implement our own caching mechanism.

jcnelson commented 10 years ago

Implemented our own caching mechanism (UG/cache.cpp).