refactor local_chat & config setting

kvcache-ai / ktransformers

A Flexible Framework for Experiencing Cutting-edge LLM Inference Optimizations

Apache License 2.0

745 stars 39 forks source link

refactor local_chat & config setting #110

Closed KMSorSMS closed 3 weeks ago

KMSorSMS commented 3 weeks ago

统一了config设置到yml文件，重写local chat的逻辑复用server的流程 Unified config Settings to the yml file, rewriting the process of local_chat's logical to reuse the server code