Optimize, batch, size and rate limits

567-labs / fastllm

A collection of LLM services you can self host via docker or modal labs to support your applications development

MIT License

181 stars 23 forks source link

Open jxnl opened 9 months ago