search

awsaf49 / gcvit-tf

Tensorflow 2.0 Implementation of GCViT: Global Context Vision Transformer
MIT License
26 stars 5 forks source link

Fixed casting for mixed precision support #10

Closed andreped closed 1 year ago

andreped commented 1 year ago

Related to issue https://github.com/awsaf49/gcvit-tf/issues/7 and PR https://github.com/awsaf49/gcvit-tf/pull/8.

I also updated the original gist, demonstrating that these changes resolves the issue, see here.

awsaf49 commented 1 year ago

I am merging this PR, by the way in mixed_preision float32 is also used in the head. refer to link