search

opendatahub-io / vllm-tgis-adapter

vLLM adapter for a TGIS-compatible gRPC server.
Apache License 2.0
8 stars 11 forks source link

Support suffix for fill-in-the-middle #172

Open njhill opened 3 weeks ago

njhill commented 3 weeks ago

Not to be merged yet, this depends on upstream vLLM PR https://github.com/vllm-project/vllm/pull/9522.