search

InftyAI / llmlite

🌵 A library helps to communicate with all kinds of LLMs consistently.
MIT License
12 stars 2 forks source link

support batching #46

Closed Jerry-Kon closed 11 months ago

kerthcet commented 11 months ago

close in favor of https://github.com/InftyAI/llmlite/pull/50