Oneflow-Inc / one-codegeex

Apache License 2.0
7 stars 1 forks source link

add fused_codegeex_qkv_reshape #21

Closed BBuf closed 1 year ago

BBuf commented 1 year ago

把fused_codegeex_qkv_reshape加回来,可以节省q,k,v做tocongiguous(reshape)的开销。nsys分析见:https://github.com/Oneflow-Inc/oneflow/pull/9927