add feature about vllm backend

InftyAI / llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.

MIT License

12 stars 2 forks source link

Closed Jerry-Kon closed 11 months ago

kerthcet commented 11 months ago

I'll merge this PR first because I want to add more features ASAP, so I'll help you fix the comments. Thanks.