Add version to validate from torchtext validate binaries call

PaliC commented 3 months ago

Adds option to validate against a specific version of pytorch

pytorch-bot[bot] commented 3 months ago

:link: Helpful Links

:test_tube: See artifacts and rendered test results at hud.pytorch.org/pr/pytorch/text/2240

:page_facing_up: Preview Python docs built from this PR

Note: Links to docs will display an error until the docs builds have been completed.

:x: 11 New Failures, 6 Unrelated Failures

As of commit 5dd14492c52da39e0e9f78c0802ce77ee1b15446 with merge base 656a3b48d14c18d816f071dfb7449daa852fc219 ():

NEW FAILURES - The following jobs have failed:

* [Bandit / build](https://hud.pytorch.org/pr/pytorch/text/2240#22946359591) ([gh](https://github.com/pytorch/text/actions/runs/8379441110/job/22946359591)) `Process completed with exit code 1.` * [Build Windows Conda / pytorch/text / upload / conda-py3_8-cpu](https://hud.pytorch.org/pr/pytorch/text/2240#22947228610) ([gh](https://github.com/pytorch/text/actions/runs/8379441244/job/22947228610)) `Unable to find any artifacts for the associated workflow` * [cron / nightly / validate-binaries / linux-manywheel-3.8-rocm5.7 / linux-manywheel-3.8-rocm5.7](https://hud.pytorch.org/pr/pytorch/text/2240#22946374744) ([gh](https://github.com/pytorch/text/actions/runs/8379441268/job/22946374744)) `RuntimeError: Command docker exec -t 8e4cf028f53f0750788ccc9dbc812671d68ad3150f65a768bffd53c26221c299 /exec failed with exit code 1` * [cron / nightly / validate-binaries / linux-manywheel-3.8-rocm6.0 / linux-manywheel-3.8-rocm6.0](https://hud.pytorch.org/pr/pytorch/text/2240#22946375038) ([gh](https://github.com/pytorch/text/actions/runs/8379441268/job/22946375038)) `RuntimeError: Command docker exec -t a7f42c768c69d68caa0ce513ee384e905a355462d15b382fc67acccba51e60ce /exec failed with exit code 1` * [cron / nightly / validate-binaries / windows-wheel-3.8-cpu / windows-wheel-3.8-cpu](https://hud.pytorch.org/pr/pytorch/text/2240#22946373802) ([gh](https://github.com/pytorch/text/actions/runs/8379441268/job/22946373802)) `RuntimeError: torchdata binary 0.7.0.dev20231010 is more than 3 days old!` * [Integration Test / tests (3.8) / linux-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946360572) ([gh](https://github.com/pytorch/text/actions/runs/8379441200/job/22946360572)) `RuntimeError: Command docker exec -t 218f4d9d46339ffbed69771210c1aeae213d3e3bb6364dd683c09aef8601d8fc /exec failed with exit code 1` * [Lint / python-source-and-configs / linux-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946361311) ([gh](https://github.com/pytorch/text/actions/runs/8379441225/job/22946361311)) `RuntimeError: Command docker exec -t fa11e6295f62a58422a82af5965b33d2c0bad0aaa85acb5712f94eddf8a4606f /exec failed with exit code 1` * [Unit-tests on Linux CPU / tests (3.8) / linux-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946360503) ([gh](https://github.com/pytorch/text/actions/runs/8379441201/job/22946360503)) `RuntimeError: Command docker exec -t 936765a981e8742c4b76efc6b5022d49c66651394d9aa01ac07c5fe9770687b0 /exec failed with exit code 1` * [Unit-tests on Linux CPU / tests (3.9) / linux-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946361186) ([gh](https://github.com/pytorch/text/actions/runs/8379441201/job/22946361186)) `RuntimeError: Command docker exec -t be977e3019bada14ae018060c82a701777a2431545af99fc8e7bb69808835a9e /exec failed with exit code 1` * [Unit-tests on Linux GPU / tests (3.8, 11.7) / linux-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946361080) ([gh](https://github.com/pytorch/text/actions/runs/8379441212/job/22946361080)) `RuntimeError: Command docker exec -t af89b5f45f54c8a8ee31c10e11493c3f2aeeb22bc6c46eaabbed4144cdb86196 /exec failed with exit code 1` * [Unit-tests on Windows CPU / tests (3.8) / windows-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946361390) ([gh](https://github.com/pytorch/text/actions/runs/8379441224/job/22946361390)) `torchtext_unittest\datasets\test_iwslt2016.py::TestIWSLT2016::test_iwslt2016_068_train`

BROKEN TRUNK - The following jobs failed but were present on the merge base:

👉 Rebase onto the `viable/strict` branch to avoid these failures

* [cron / nightly / validate-binaries / windows-conda-3.8-cpu / windows-conda-3.8-cpu](https://hud.pytorch.org/pr/pytorch/text/2240#22946373531) ([gh](https://github.com/pytorch/text/actions/runs/8379441268/job/22946373531)) `Process completed with exit code 1.` * [Unit-tests on Linux CPU / tests (3.10) / linux-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946361582) ([gh](https://github.com/pytorch/text/actions/runs/8379441201/job/22946361582)) * [Unit-tests on Macos CPU / tests (3.10) / macos-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946360876) ([gh](https://github.com/pytorch/text/actions/runs/8379441202/job/22946360876)) ` thinc/backends/numpy_ops.cpp:5948:3: error: no member named 'use_tracing' in '_PyCFrame'` * [Unit-tests on Macos CPU / tests (3.8) / macos-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946360310) ([gh](https://github.com/pytorch/text/actions/runs/8379441202/job/22946360310)) ` thinc/backends/numpy_ops.cpp:5948:3: error: no member named 'use_tracing' in '_PyCFrame'` * [Unit-tests on Macos CPU / tests (3.9) / macos-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946361339) ([gh](https://github.com/pytorch/text/actions/runs/8379441202/job/22946361339)) ` thinc/backends/numpy_ops.cpp:5948:3: error: no member named 'use_tracing' in '_PyCFrame'` * [Unit-tests on Windows CPU / tests (3.9) / windows-job](https://hud.pytorch.org/pr/pytorch/text/2240#22946361817) ([gh](https://github.com/pytorch/text/actions/runs/8379441224/job/22946361817)) `torchtext_unittest\test_build.py::TestDataUtils::test_get_tokenizer_spacy`

This comment was automatically generated by Dr. CI and updates every 15 minutes.

atalman commented 3 months ago

Need to add a call to:

  generate-release-matrix:
    uses: pytorch/test-infra/.github/workflows/generate_release_matrix.yml@main
    with:
      version: ${{ inputs.version }}

See: https://github.com/pytorch/builder/blob/main/.github/workflows/validate-binaries.yml#L106

atalman commented 3 months ago

Also need to change /.github/scripts/validate_binaries.sh to install required version of text retrieved from generate-release-matrix call

pytorch / text