Move inference server to local transformers module

567-labs / fastllm

A collection of LLM services you can self host via docker or modal labs to support your applications development

MIT License

182 stars 23 forks source link

Closed jxnl closed 10 months ago