nod-ai / serve

Serve, optimize and scale PyTorch models in production
https://pytorch.org/serve/
Apache License 2.0
1 stars 0 forks source link

Investigate XLA support #16

Open eppane opened 2 weeks ago

eppane commented 2 weeks ago

PyTorch/XLA is a Python package that uses the XLA deep learning compiler to connect the PyTorch deep learning framework and Cloud TPUs.

PyTorch/XLA documentation — PyTorch/XLA master documentation OpenXLA Project

Action points:

Investigate and document the level of XLA support, is it inherent part of TorchServe or an extension. Define further action points after research.