Update transformers test requirements - Githubissues

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

https://onnxruntime.ai

MIT License

14.77k stars 2.94k forks source link

Update transformers test requirements #22911

Open tianleiwu opened 1 day ago

tianleiwu commented 1 day ago

Description

Install PyTorch for transformers tests. The installation is before python tests so that it can use torch if needed.
Update protobuf and numpy versions used in transformers test.

Motivation and Context

Currently, transformers tests are enabled in the following CI pipelines:

Linux CPU CI Pipeline (torch for cpu-only)
Linux GPU CI Pipeline (torch for cuda 12)
Windows GPU CUDA CI Pipeline (torch for cpu-only right now, note that we might change it to torch for cuda 12 in the future).

For ROCm CI Pipeline, transformer tests are enabled but skipped since onnx package is not installed in CI.

Previously, torch was not installed before python tests, so some tests depending on torch were skipped like test_bind_onnx_types_not_supported_by_numpy or test user_compute_stream.

In this PR, we changed build.py to install torch before running python tests.