search

PaddlePaddle / Paddle-Lite

PaddlePaddle High Performance Deep Learning Inference Engine for Mobile and Edge (飞桨高性能深度学习端侧推理引擎）
https://www.paddlepaddle.org.cn/lite
Apache License 2.0
6.89k stars 1.6k forks source link

[XPU] support token-slice for encoder #10470

Open TR666 opened 3 months ago

TR666 commented 3 months ago

PR devices

XPU

PR types

New features

PR changes

PASS

Description

适配encoder的剪枝逻辑，支持multi-encoder的每层seq长度不一样 去掉mask结构中，多余的slice算子

paddle-bot[bot] commented 3 months ago

Thanks for your contribution!