Closed suisiyuan closed 2 months ago
add tp, kvcache and schedule support for chatglm2-6b model for gpu backend as demo project.
add tp, kvcache and schedule support for chatglm2-6b model for gpu backend as demo project.