Trying to run longformers on TPU

allenai / longformer

Longformer: The Long-Document Transformer

https://arxiv.org/abs/2004.05150

Apache License 2.0

2.05k stars 276 forks source link

Trying to run longformers on TPU #221

Open siddagra opened 2 years ago

siddagra commented 2 years ago

I upgraded to the latest version of the longformers and am trying to run on google TPU but I keep getting the error: RuntimeError: Error while lowering: fp32

reproducible code: https://colab.research.google.com/drive/1HH_byzmMPjgy-7c000aOKANrqoM0ZSK7?usp=sharing

How do I fix this? Please help me! I beg you!