search

google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
Apache License 2.0
21 stars 12 forks source link

Update Jetstream commit id #108

Closed FanhaiLu1 closed 1 month ago

FanhaiLu1 commented 1 month ago

Update jetstream commit id to https://github.com/google/JetStream/commit/e19a7906d8cdf1cae658a4c7c4f6f516aade49f9. This commit added Add ray disaggregated serving support in Jetstream.