vLLM support integration

Deelvin / lmentry

1 stars 2 forks source link

Closed dsbarinov1 closed 1 year ago

dsbarinov1 commented 1 year ago

Purpose: integrate vLLM pipeline in order to benchmark vLLM models with Lmentry.