Add offline inference with vllm backend - Githubissues

FlagOpen / FlagScale

FlagScale is a large model toolkit based on open-sourced projects.

Other

132 stars 40 forks source link

Add offline inference with vllm backend #143

Closed zhaoyinglia closed 3 months ago