huggingface / optimum-tpu

Google TPU optimizations for transformers models

Apache License 2.0

75 stars 19 forks source link

Update to Pytorch 2.3.0 and transformers v4.40.2 #41

Closed tengomucho closed 6 months ago

tengomucho commented 6 months ago

What does this PR do?

A rather uninteresting PR, that updates Pytorch and transformers dependency versions, and makes sure that everything still works as before. This will however allow to integrate some features that have been integrated on PT2.3 and newer transformers vesions.

Before submitting

[x] Did you make sure to update the documentation with your changes?
[x] Did you write any new necessary tests?

tengomucho commented 6 months ago

I will update to transformers 4.41 later, because there are some incompatibilities due to changes in static KV cache handling.