kvcache-ai / ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations
Apache License 2.0
741 stars 39 forks source link

[feature] support for pypi install #14

Closed UnicornChan closed 3 months ago

UnicornChan commented 3 months ago
  1. Complete the submission information for PyPI.
  2. Support for dynamically detecting the current environment of the client. If precompiled packages can be used for installation, download and install the precompiled packages. (Adapted from flash-attn)
  3. Modified the installation process in the README.