search

HDFGroup / hermes

Extending the HDF5 library to support intelligent I/O buffering for deep memory and storage hierarchy systems
https://grc.iit.edu/research/projects/hermes
30 stars 17 forks source link

Fix issue regarding RPC unscalability. Improved RAM management for task and data allocations. #652

Closed lukemartinlogan closed 5 months ago

lukemartinlogan commented 5 months ago

This PR fixed a few issues.

  1. Fix issue regarding RPC unscalability.
  2. Improved RAM management for task and data allocations. Three separate memory allocators for tasks, runtime data, and client data.
  3. Fix an issue with data staging where the protocol was not always deserialized properly in remote workloads, causing IOR to fail at larger scales frequently.