search

jiazhihao / TASO

The Tensor Algebra SuperOptimizer for Deep Learning
Apache License 2.0
687 stars 90 forks source link

can taso convert old weights to to new weights? #46

Open wangxihuiok opened 4 years ago

wangxihuiok commented 4 years ago

for example, graph optimization can fuse the conv, batchnorm layer to a new conv layer, and calculate the new fused conv weight parameters, can taso calculate the new weight in the transformation after fusing conv and batchnorm?

jiazhihao commented 4 years ago

Yes, TASO preprocesses the new weights for the convolution when it is fused with a batchnorm. You can see the preprocessing steps when using TASO to optimize a ConvNet with batchnorm (e.g., ResNet).

Thanks for your interests in TASO.