google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
Apache License 2.0
21 stars 12 forks source link

make sure GPU works #130

Closed qihqi closed 1 month ago

qihqi commented 1 month ago

Need to update xla pin to https://github.com/pytorch/xla/pull/7307 as otherwise it will error on GPUs.