thomasbrandon / mish-cuda

Mish Activation Function for PyTorch
MIT License
147 stars 67 forks source link

Does not this support fp16? #3

Open CoinCheung opened 3 years ago

CoinCheung commented 3 years ago

Hi,

I am learning from your code, and I got to find in the below line that, the fp16 type is converted to float which is not computed with fp16 method. Would you please explain why you did not use fp16 function? https://github.com/thomasbrandon/mish-cuda/blob/c54271c725d57af62968e960598ffedd4896ef94/csrc/mish.h#L40