pytorch / text

Models, data loaders and abstractions for language processing, powered by PyTorch
https://pytorch.org/text
BSD 3-Clause "New" or "Revised" License
3.5k stars 812 forks source link

[Release Blocking] TorchData is too old for PyTorch 2.3 #2239

Open PaliC opened 6 months ago

PaliC commented 6 months ago

Currently the release of TorchText 0.18 is blocked by using TorchData 7.1 which is not compatible with PyTorch 2.3 (https://github.com/pytorch/text/actions/runs/8365635868/job/22903939847#step:13:291)

Solution: The first proposed solution is to cut a branch for TorchData 7.2 and use that as https://github.com/pytorch/data/commit/07903385443da2cab8ed90c46bd4e02412945100 fixes the issue.

malfet commented 6 months ago

Should we remove torchdata integration with torchtext instead? And indeed, it's a TorchText release blocking issue, but it should not delay the release of PyTorch itself