search

intel / intel-extension-for-deepspeed

Intel® Extension for DeepSpeed* is an extension to DeepSpeed that brings feature support with SYCL kernels on Intel GPU(XPU) device. Note XPU is already supported in stock DeepSpeed (upstream).
MIT License
57 stars 19 forks source link

add RoPE flag, don't merge #44

Open Yejing-Lai opened 1 year ago

Yejing-Lai commented 1 year ago

Replace position embedding in training with RoPE.