Support for vLLM - Githubissues

bigcode-project / bigcode-evaluation-harness

A framework for the evaluation of autoregressive code generation language models.

Apache License 2.0

825 stars 219 forks source link

Open noforit opened 7 months ago

noforit commented 7 months ago

Could you please inform me about when support might be available for VLLM accelerated inference?