search

henk717 / KoboldAI

KoboldAI is generative AI software optimized for fictional use, but capable of much more!
http://koboldai.com
GNU Affero General Public License v3.0
352 stars 130 forks source link

Update IPEX engine #487

Closed Disty0 closed 7 months ago

Disty0 commented 7 months ago

This update fixes some dtype errors, UntypedStorage, Generator and torch.load.

henk717 commented 7 months ago

Also heads up, we will be making the jump to Torch 2.1 soon.

Disty0 commented 7 months ago

A release branch for PyTorch 2.1 exist right now but it will probably take a few weeks for Intel to release it as a prebuilt package: https://github.com/intel/intel-extension-for-pytorch/tree/release/xpu/2.1.10

Disty0 commented 7 months ago

A release branch for PyTorch 2.1 exist right now but it will probably take a few weeks for Intel to release it as a prebuilt package: https://github.com/intel/intel-extension-for-pytorch/tree/release/xpu/2.1.10

It got released today. IPEX should be ready to jump too.