flux-framework / dyad

DYAD: DYnamic and Asynchronous Data Streamliner
GNU Lesser General Public License v3.0
6 stars 5 forks source link

Fix DYAD consumer fsync #98

Closed hariharan-devarajan closed 5 months ago

hariharan-devarajan commented 5 months ago

Currently as we have one fd we need an fsync before releasing a lock.

What we can do is have a dummy fd on which we take a lock. Then actual consumption (remote read + write) happens on a fd and we just close it. Then we release the lock on dummy fd and then close that fd as well.

This would significantly improve I/O of consumer.