pytorch / text

Models, data loaders and abstractions for language processing, powered by PyTorch
https://pytorch.org/text
BSD 3-Clause "New" or "Revised" License
3.49k stars 813 forks source link

torchtext 0.16.0 wheels are missing for aarch64 linux platform #2208

Open snadampal opened 10 months ago

snadampal commented 10 months ago

🐛 Bug

Describe the bug A clear and concise description of what the bug is. torchtext 0.16.0 wheels are missing for aarch64 linux platform. This is breaking the torchbench benchmarks on aarch64 linux, because (1) torchbench requires torchtext and (2) torchtext 0.15.2 is not compatible with torch 2.1.0

To Reproduce Steps to reproduce the behavior:

# Install PyTorch and extensions
python3 -m pip install torch
python3 -m pip install torchvision torchaudio torchtext

# Clone PyTorch benchmark repo
git clone https://github.com/pytorch/benchmark.git

# Setup Resnet50 benchmark
cd benchmark
python3 install.py resnet50

Expected behavior A clear and concise description of what you expected to happen. torchtext 0.16.0 wheels are published for aarch64 linux platform

Screenshots If applicable, add screenshots to help explain your problem.

Environment AWS Graviton3 with Ubuntu 22.04

Please copy and paste the output from our environment collection script (or fill out the checklist below manually).

You can get the script and run it with:

wget https://raw.githubusercontent.com/pytorch/pytorch/master/torch/utils/collect_env.py
# For security purposes, please check the contents of collect_env.py before running it.
python collect_env.py
python -c "import torchtext; print(\"torchtext version is \", torchtext.__version__)"

Additional context Add any other context about the problem here.

malfet commented 10 months ago

Yes, this results from a fact that torchtext has never been added to the automated pipeline that were build for torchvision and torchaudio. On the other hand, torchtext should not be a mandatory dependency for the latest torchbench, should it?

snadampal commented 10 months ago

thanks, @malfet. Sorry, my scripts are using the torchbench from a commit, but looks like the dependency is removed in the latest torchbench. If torchtext dependency is deprecated for every project, then we are good. Otherwise, there is a need for the updated wheels that are compatible with torch 2.1.