[GPU] Added RoPE support for ChatGLM - Githubissues

openvinotoolkit / openvino

OpenVINO™ is an open-source toolkit for optimizing and deploying AI inference

https://docs.openvino.ai

Apache License 2.0

6.12k stars 2.04k forks source link

[GPU] Added RoPE support for ChatGLM #24533

Closed Lyamin-Roman closed 3 days ago

Lyamin-Roman commented 2 weeks ago

Details:

Moved CPU rope fusion transformation to the common part
Implemented ocl kernel for RoPE in ChatGLM

Tickets:

119150