Closed ordabayevy closed 1 month ago
sync_dist=True
TDigest
torchdistributed.gather_object
GatherLayer
get_rank_and_num_replicas
cellarium.ml.utilities.distributed
sync_dist=True
flag to train loss logTDigest
usetorchdistributed.gather_object
instead of writing/reading tdigest objects from filesGatherLayer
andget_rank_and_num_replicas
tocellarium.ml.utilities.distributed