search

replicate / cog-llama-template

LLaMA Cog template
Apache License 2.0
307 stars 52 forks source link

working vllm engine #50

Closed daanelson closed 1 year ago

daanelson commented 1 year ago

updated vllm config to manage weights with the Weights object.