huggingface / huggingface.js

Utilities to use the Hugging Face Hub API
https://hf.co/docs/huggingface.js
MIT License
1.29k stars 160 forks source link

Add vLLM to local-apps #744

Open mgoin opened 1 month ago

mgoin commented 1 month ago

vLLM is a high-throughput and memory-efficient open-source serving engine for LLMs.

vLLM is fast with:

Transparent Logo: vllm-logo-text-light