flexible storage backend (gasnet, local ram)

dotnwat / gassyfs

gassyfs - distributed in-memory file system over RDMA

GNU Lesser General Public License v2.1

29 stars 6 forks source link

flexible storage backend (gasnet, local ram) #36

Closed dotnwat closed 8 years ago

dotnwat commented 8 years ago

We need a flexible mechanism for dealing with different storage backends. For example, with GASNet-[Large|Fast] GASNet performs memory allocation on our behalf and informs us of the address space ranges on each node. With GASNet-Everything we have to allocate and manage our own ranges, and presumably there could me multiple per node. Likewise, a local RAM-based backend could be a special case of this with a local mmap rather than using malloc for each byte.

dotnwat commented 8 years ago

Add RAM-only mode
Add mem alloc config option for everything/ram-only modes

dotnwat commented 8 years ago

check sshfs for extended options handling
option to allocate or not allocate (defualt) on rank 0 in everthing/large configurations