search

flux-framework / dyad

DYAD: DYnamic and Asynchronous Data Streamliner
GNU Lesser General Public License v3.0
7 stars 5 forks source link

Adds optimizations to the UCX DTL to improve performance #58

Closed ilumsden closed 2 months ago

ilumsden commented 8 months ago

This PR adds optimizations to the UCX DTL to improve DYAD's performance. Currently, the optimizations that will be added are:

  1. Allocating memory buffers using UCX
  2. Running a warmup communication with self to help initialize UCX components
  3. Cache UCX endpoints in server to minimize the number of connection establishments required
ilumsden commented 8 months ago

Note that this PR is based on #56 to allow us to use the most recently updated CI for automated testing

ilumsden commented 2 months ago

Verify that this was worked into another PR. If so, close.