issues
search
DefTruth
/
Awesome-LLM-Inference
📖A curated list of Awesome LLM Inference Paper with codes, TensorRT-LLM, vLLM, streaming-llm, AWQ, SmoothQuant, WINT8/4, Continuous Batching, FlashAttention, PagedAttention etc.
https://github.com/DefTruth/Awesome-LLM-Inference
GNU General Public License v3.0
2.59k
stars
174
forks
source link
🔥🔥[500xCompressor] 500xCompressor: Generalized Prompt Compression for…
#31
Closed
DefTruth
closed
1 month ago
DefTruth
commented
1 month ago
… Large Language Models
… Large Language Models