search

huggingface / transformers

🤗 Transformers: State-of-the-art Machine Learning for Pytorch, TensorFlow, and JAX.
https://huggingface.co/transformers
Apache License 2.0
134.99k stars 27k forks source link

Reformer now requires PyTorch 1.6.0 #6277

Closed sgugger closed 4 years ago

sgugger commented 4 years ago

@patrickvonplaten, one of your recent PR (#6244) on Reformer introduces a dep on PyTorch 1.6.0 minimum by using torch.cuda.default_generators. We should see if we can find a way to work around this.

patrickvonplaten commented 4 years ago

yes! I think the change #6244 is also only necessary in PyTorch 1.6 -> maybe we can even hard-code torch.__version__ in the code and use the appropriate functions accordingly. Think this is also very much related to the previous bug: https://github.com/pytorch/pytorch/issues/33546

patrickvonplaten commented 4 years ago

6300 should fix it.