Support for vLLM - Githubissues

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

Apache License 2.0

698 stars 180 forks source link

Open noforit opened 2 months ago

noforit commented 2 months ago

Could you please inform me about when support might be available for VLLM accelerated inference?