FMInference / FlexLLMGen

Running large language models on a single GPU for throughput-oriented scenarios.
Apache License 2.0
9.18k stars 548 forks source link

[Feature] Intel dGPU/SYCL support #125

Open abhilash1910 opened 1 year ago

abhilash1910 commented 1 year ago

Thanks for the framework, this is a progressive PR on enabling Intel GPU/SYCL support for Flexgen. (Draft stage). Tagging @Ying1123