Add shard on batch mode. Als update version of torchxla2

google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"

Apache License 2.0

32 stars 14 forks source link

Closed qihqi closed 3 months ago