search

runpod-workers / worker-vllm

The RunPod worker template for serving our large language model endpoints. Powered by vLLM.
MIT License
213 stars 82 forks source link

Fixes import statement #48

Closed rachfop closed 6 months ago

rachfop commented 6 months ago

Fixes import statements, formats tables, run black on code blocks.