search

google / jetstream-pytorch

PyTorch/XLA integration with JetStream (https://github.com/google/JetStream) for LLM inference"
Apache License 2.0
21 stars 12 forks source link

Add regression test to detect service broken and performance degradation #94

Open FanhaiLu1 opened 1 month ago

FanhaiLu1 commented 1 month ago

We saw few service broken and performance degradation in last two weeks, it's hard to identify which PR cause the issues when the issue was found few days later.

Right now, there is no regression test for jetstream pytorch serving. Regression test is necessary to catch the broken or degradation bug.