intel / llm-on-ray

Pretrain, finetune and serve LLMs on Intel platforms with Ray
Apache License 2.0
103 stars 30 forks source link

Add support for HPU quantization and torch_compile #207

Closed kira-lin closed 6 months ago