search

google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
Apache License 2.0
33 stars 14 forks source link

Stacked cache for MLPerf #154

Closed wang2yn84 closed 1 month ago

wang2yn84 commented 1 month ago

Same as https://github.com/google/jetstream-pytorch/pull/151, check in to this branch for MLPerf