InftyAI / llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.
MIT License
12 stars 2 forks source link

Support serving via HTTP/RPC server #40

Open kerthcet opened 1 year ago