search

InftyAI / llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.
MIT License
9 stars 3 forks source link

support vllm #50

Closed kerthcet closed 9 months ago

kerthcet commented 9 months ago

fix https://github.com/InftyAI/llmlite/issues/32

kerthcet commented 9 months ago

cc @Jerry-Kon