jiazhihao / TASO

The Tensor Algebra SuperOptimizer for Deep Learning
Apache License 2.0
682 stars 89 forks source link

Softmax support in TASO #83

Open MadFunMaker opened 3 years ago

MadFunMaker commented 3 years ago

Could you make the TASO support softmax operator given the popularity of it? We want to run TASO with the transformer architecture or the entire ResNet network, but lack of softmax support becomes a bottleneck and I believe we are not the only one who wants to run the TASO with such popular models.