ggerganov / ggml

Tensor library for machine learning
MIT License
11.26k stars 1.05k forks source link

SYCL: do not skip CPU if explicitly selected #937

Closed smeso closed 2 months ago

smeso commented 3 months ago

It can be useful to be able to use SYCL on CPU e.g. to run tests on a machine without a GPU, like GH's free runners.

With this commit a user can enable the use of the CPU with the following env variable:

export ONEAPI_DEVICE_SELECTOR="opencl:cpu"

slaren commented 2 months ago

This may get more attention from the SYCL developers if the PR is opened in the llama.cpp repository instead.

smeso commented 2 months ago

Oh, thanks for the heads up! Then I'll close this PR and open a similar one in llama.cpp.