Closed TevenLeScao closed 1 year ago
This feature is needed for users that want to define the get_shapes function themselves, for example in tensor-parallel environments where each process only sees a fraction of the parameters.
get_shapes
This feature is needed for users that want to define the
get_shapes
function themselves, for example in tensor-parallel environments where each process only sees a fraction of the parameters.