fix batching bug - Githubissues

predibase / lorax

Multi-LoRA inference server that scales to 1000s of fine-tuned LLMs

https://loraexchange.ai

Apache License 2.0

1.86k stars 125 forks source link

fix batching bug #513

Closed magdyksaleh closed 2 weeks ago