disable view - Githubissues

Oneflow-Inc / one-codegeex

Apache License 2.0

7 stars 1 forks source link

disable view #11

Closed BBuf closed 1 year ago

BBuf commented 1 year ago

禁用VIEW机制，获取更多优化机会。

[ ] 优化点1： fuse q, k, v transpose: https://github.com/Oneflow-Inc/one-codegeex/blob/main/codegeex/oneflow/codegeex_model.py#L112-L125
[ ] 优化点2: fuse 下面几个kernel：https://github.com/Oneflow-Inc/one-codegeex/blob/main/codegeex/oneflow/codegeex_model.py#L151-L156
[ ] 优化点3: value_layer和attention_probs的fuse。https://github.com/Oneflow-Inc/one-codegeex/blob/main/codegeex/oneflow/codegeex_model.py#L214-L219
[ ] 优化点4: context layer的融合：https://github.com/Oneflow-Inc/one-codegeex/blob/main/codegeex/oneflow/codegeex_model.py#L223-L231