add feature about vllm backend

InftyAI / llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.

MIT License

9 stars 3 forks source link

Closed Jerry-Kon closed 9 months ago

kerthcet commented 9 months ago

I'll merge this PR first because I want to add more features ASAP, so I'll help you fix the comments. Thanks.