Closed vchiley closed 1 year ago
This PR
reset_parameters
FusedExpertNetwork
to(*args)
FusedExpertsNetwork
self.fc1_weight
self.fc2_weight
self.fc1_bias
self.fc2_bias
device=device
dtype=dtype
@microsoft-github-policy-service agree company="MosaicML"
This PR
reset_parameters
fn toFusedExpertNetwork
.to(*args)
fn fromFusedExpertsNetwork
self.fc1_weight
,self.fc2_weight
,self.fc1_bias
, orself.fc2_bias
.to(*args)
fn is a bug.device=device
anddtype=dtype
to parameter init