kvcache-ai / ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
Apache License 2.0
729 stars 37 forks source link

[update] Update readme; Add tutorial #35

Closed Azure-Tang closed 2 months ago

Azure-Tang commented 2 months ago

Update readme; add pipeline tutorial; add detailed inject tutorial