search

google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
Apache License 2.0
32 stars 14 forks source link

Comment broken function to unblock interactive run after JetStream api change #60

Closed FanhaiLu1 closed 4 months ago

FanhaiLu1 commented 4 months ago

JetStream PR 40 removed mix_decode function (https://github.com/google/JetStream/commit/a0df320cb4a720bf123e2579973034628dbe3344#diff-1f6a127e88897ae4bd1191a2b3609a1507a9e667fbc22dda89f67b26653e99eb).

Pytorch engine is depending on mix_decode and use it to do stream decode. Comment this part of code to unblock pytorch engine interactive run.