pytorch / xla

Enabling PyTorch on XLA Devices (e.g. Google TPU)
https://pytorch.org/xla
Other
2.48k stars 479 forks source link

Model support for `hf_GPT2_large` with Torch_XLA2 #8136

Open ManfeiBai opened 1 month ago

ManfeiBai commented 1 month ago

Fix the model test for hf_GPT2_large.py

  1. setup env according to Run a model under torch_xla2
  2. Run model test under run_torchbench/ with python models/your_target_model_name.py
  3. Fix the failure.

Please refer to this guide as guide to fix:

Also refer to these PRs:

barney-s commented 5 days ago

https://github.com/pytorch/xla/issues/8136

barney-s commented 5 days ago

please assign this to me @ManfeiBai