search

openucx / ucc

Unified Collective Communication Library
https://openucx.github.io/ucc/
BSD 3-Clause "New" or "Revised" License
177 stars 85 forks source link

Alltoallv Perftest - Transfer Matrix #967

Closed x41lakazam closed 1 month ago

x41lakazam commented 2 months ago

Currently in alltoallv perftest, every rank is sending the same amount of data to every other rank, this PR implements the possibility to define the amount of data rank i should send to rank j, using a matrix called "transfer matrix" (where the cell i,j is this amount of data)

The transfer matrix should be written in a file where each row contains the elements separated by a space, each element is a number of bytes. It support convenient unit usage of megabytes and gigabytes, in the format 1G or 5M. The path to the transfer matrix file should be passed in the environment variable UCC_PT_COLL_ALLTOALLV_TRANSFER_MATRIX_FILE

swx-jenkins3 commented 2 months ago

Can one of the admins verify this patch?