search

google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
Apache License 2.0
33 stars 14 forks source link

Use kwargs to simplify the call sites a bit #175

Closed yixinshi closed 2 weeks ago

yixinshi commented 2 weeks ago

Tested by running a gemma2 local test: https://github.com/google/jetstream-pytorch?tab=readme-ov-file#gemma-7b